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I. INTRODUCTION 

This thesis concentrates on the Marine Corps DevelcEment 
and Education Ccmmand, Research and Development Precgram 
Frioritization Process. The process was originally froposed 
to assist in develcfing the Marine Corps' input to the 
Navy's Research, Development, Test and Evaluation (FDT&E,N) 
Erogram Ckjective Memorandum (POM). The process comtines 
subjective evaluvuaticns of the Marine Corrps' identified 
mMissicn deficiercies and proposed RDT&E programs, and 
produces a RDT&E program rank ordering according to missicn 
deficiency accomplishment importance. The Department of 
Defense acquisition system is reviewed as it establishes the 
base for Marine Corps RDT&E frogram acquisition. Review o£ 
current acquisition frocedures reveal that analytic medels 
are used in support cf£ the Procurement Marine Corps (P4¥C) 
Boiebut pet fom Sanrine Corps RET&SE,N POM anput. 

The literature concerning research and develcpment 
Frogram selection models 1s reviewed. The review shows that 
awide range of pregram selection models are propcesed and 
accepted by industry. The literature lends credence tc the 
MCDEC process by allcwing precess classification with the 
Majority cf industry accepted models. Mathematical froegran- 
Ming €nhancement to this classification is suggested by the 
literature and is illustrated in this investigation. Linear 
Frogramring formulations are used to duplicate the M§FCIEC 
Frocess and suggest mathematical programming advantages 
under fudget reducticr conditicns. A MCDEC produced process 
test data set is used to further illustrate the linear 
programming forgulations. A second linear programming 
approach is suggested which concentrates on the number of 


missicn deficiencies accomplished rather than the k&DTS&E 


progrars and presents a favorable program seleacticn nodel 
alternative for the sample data set. 

Furtkter investigation 1S required to establish cther 
fossiftle alternatives suggested by the literature and for 
the inplemertation of a Marine Corps RDT&E program selection 
Process. Further consideration of the costs associated mwaeg 
software, data collection, and manpower requirements wiil be 
necessary aS weil as comparing these costs with the benefits 
received frcm a frocess implementation. 
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II. BACKGROUND 


A. INIRCDUCTION 


Tice lanmngya 9 Led canmang,, sand Budgeting System ({FPES) 
structures the defense systems acjuisition procedure within 
the Lepartment of Defense (DOD). This Structure 2S a step- 
wise review and decision process conducted at various levels 
in the [oD hierarchy. The process translates validated 
defense mission needs into budget allocations which fund 
programs that are expected to cvercome tne stated needs. [In 
this thesis the hierarchical level of concern descends iron 
the Office cf the Secretary of Defense (Ost, throug: the 
Department of the Navy (DON), to the Marine Corps and the 
Navy. Ihe analysis concentrates on the initial PPS steps 
taken at this level, and specifically the Research, 
Develcyment, Test, and Evaluation (RDT&E) acquisition 
program fricritizaticr and funding profile process used by 


the Marine Corps. 


Pee OXYSTENS ACODLSITICN IN USMC 


1. Fesponsibilities 


=— <= oo cme ee eS 


Specific responsibilities are assigned the Marine 
Corps ky law.! Figure 2.1 depicts three levels 9f RITSE and 
systems acquisition tanagement that assist in accomplishing 
these respensibilities. The RDT&E and system acguisition 


BeseetlotemerrleS statedman NEO 5000. 10A) [Ref 1} first 


1The National BEC EEA ET Act of 1947, as amended, and 
subsequent DoD and SecNav directives assign the Marine Corps 
eneral and specific responsibilities or developing the 
amet ics, tec Bee and equipment used a amphikious 
landing forces. he Marine Corps is directed to cocrdinate 
and reguest Shc Late assistance for this development with 
the Navy and other military services. 
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designates the Assistant Commandant of the Harine Corps 
(ACMC) as the acquisition executive and then assigns him the 
responsitility for cverall integration and unificaticomee 
the management process. The Deputy Chief of Staff (Gy 
for Research, Development, and Studies (RD&S) assists the 
ACMC by acting as the coordinator of staff acti vase 
involved in RDT&E and system acquisition from program initi- 
ation to aprfroval for service use. The Commanding General, 
Marine Cerps Development and Education Command (CG, MCDEC) 
is the field representative of the Commandant of the Marine 
Gorpe “(eMe) in RDT&E efforts and is responsible for the 
field execution and coordination of Marine Corps! RDT&E 
activities to suppcrt the systems acquisition. This 
includes coordinating Marine Corps support needs with cther 
Hilitary services, as well as reporting on RDT&E efforts of 


cther services, agencies, and governments. 


SS SS SS ae ee eee eee aS eee es aa a Se ee ee ee See See ER ee ee 
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FIQuneC + 2..1 RDIEE and System Acquisition levels. 


The deputy chiefs of staff or directors of major 
staff offices at Headguarters Marine Corps (HQMC) are 
assigned aS program sponsors for specific Marine Corps 


Missicn areas and are intimately involved in the acquisition 


process. The program spenscrs are responsible for the 
continuous analysis cf their mission areas and the overali 
Planning, — Goordinaticn, and direction of reiated prcgran 
Beguisiticns: These€é responsibilities are accomplished in 
BoomdanatiLcnuwhtn De JS RDES andwGG, MCDEC. 


2. Analysis of Needs 


The directed continual analysis of mission areas by 
the program sponsors, with input from the Fleet Marine force 
(FMF), initially identifies operational mission needs. 
These needs, or equivalently mission deficiencies, are 
formally refined, additional needs identified, and related 
hew concerts formulated by Mission Area Analysis (MAA). 
MAAS are assessments of current or projected Marine Corps 
capakilities within the specific mission areas and elements 
listed in Table I and are conducted by HOMC or MCDEC staff 
sections in coordination with the program sponsors and CG, 
MCDEC. The MAA details the mission elements of Table I into 
general cpérational fissions and then further into specific 
cperational missions. These specific missions can then be 
matched against specific resources for their accomplishment. 
If ne resources are available then a deficiency is identi- 
fied and recommendations for overcoming the deficiency are 
presented. SECNAVINST 5000.1A [Ref. 2] and "A Guide for the 
Fericrmance of USHC Mission Area Analysis" [Ref. 3] detail 
the requirements and methodology of conducting MAAS. Each 
identified deficiency is formulated into a Justification for 
Major System New Start (JMSNS) or a Required Operational 
Gaepability (ROC) according to the Acguisition Category 
WSCAT). This decumentation then forms the basis for initi- 


BeIngeRDISE funding and program acquisition. 


pes 


| 
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Marine Corrs Mission Areas and Elements 
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210 Land Warfare 
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Comer evith “AND DECLTSICN PROCESS 


ss Milestones 


Four formal decision foints are established within 
the program acquisition process and are designated mnile- 
Srone>s 0, i-ehl,eand ITI. Positive approval is necessary at 
each milestcne for passaye of a program from concefticn to 
operaticnal deplcyment. Milestone 0 Signirfies prograr initi- 
Mmeren €h appreval Sof a JMNSNS er a ROC. A favorable rile- 
stone I decision gives the approval to demonstrate selected 
alternatives. Then a milestone II approval authorizes fuli 
scale development ard iimited production for operational 
Besting dnd evalvaticn. Finally, milestone III passasge is 
necessary fer production release and approval for service 
use. Marine Corps input to the RDT&E,N Program Oktjective 
Memorandum (POM) is reguired throughout this process until 
Milestcne Ili, after which acquisition funding comes under 


the Frocurement Marine Corps (FMC) POM. 


2. Fhases 


The review steps of the acquisition protess, shcwn 
in Figure 2.2 , are described as phases separated by the 
decision mgilestenes. The initial reviews and analysis 
previously discussed are included in the first, or research 
phase. Studies and MAAS conducted in this phase identify 
Mission deficiencies that, in turn, generate JMSNSs or FOCs. 
These dccuments assess the projected threat, state the 
tissicn element deficiency, identify the existing DCD cara- 
bilities, assess the impact of not acquiring or maintaining 
the capakilities, and finaliy provide a program flar to 
identify and explore competitive alternatives. 

Approval of the JMSNS or ROC at milestone O moves 
the precess from the research phase to the program initia- 


tion frhase. The oblectives of this phase include further 
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Figure 2.2 Marine Corps Acquisition Process Flow Chart. 
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program study and the development of a technological base to 
support the program through the remaining reviews and ceci- 
sions. Tasks necessary to accomplish these objectives are 
Beogtal cost analysis, operational effectiveness studies, 
alternative identification, technical and economical feasi- 
bility studies, risk determination, and further concert and 
threat analysis. The primary documents produced during this 
phase are the System Concept Paper (SCp) ZOr Mad) OL ELograns 
or the Decision Coordinating Paper (DCP) for less-than-frajor 
programs. These documents summarize the program develorment 
to date and address mission element need, technology assess- 
ment, frogram descriftion, Management plan, and acquisition 
logistics ard Manpower. 

Approval of the SCP or DCP at milestone I starts the 
demonstraticn and validation phase. Viabie alternative 
systers and critical subsystems are subjected to competitive 
demonstraticns during this’ fhase. Tasks accomplished in 
conjucticn with this phase include reviews of acquisition 
Bima tecleS,, Logistics, Manpower and training planning, as 
well as the preparation of the test and evaluatior master 
mean (lENP) . Major consideration 1S given to the thcrougnh 
understanding of the operational need and the eEvaluaticn of 
all alternatives. Each alternative's unit cost goal, life 
cycle cost, technical feasibility, and economic realism is 
reviewed. When the demonstration and vaiidation fhase 
Froduces sufficient evidence that the preferred syster can 
fulfill all necessary capabilities, and that technolcgy 
exists tc produce the system, the proyram sponsor recommends 
approval at milestone II. 

A successfully passed milestone II initiates the 
full scale development (FSD) phase. This phase ensures that 
tae engineering and ;sroduction design, test and evaluaticn, 
Perscnnel and training, and the integrated logistic surpert 


planning are completed prior to moving into production. Uron 
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completicn of all research ard development through this 
phase, the approval for service use is given at milestcne 
III. This decision tc proceed StartS the production ae 
deployment phase and also designates the shifts of funding 
from KRDI&E,N to PMC as well as the coordination respensi- 
bility from the DC/S RD&S to the Deputy Chief of Staite 


Installations and Logistics. 
3. Categories 


All misSion-essential acquisition programs in the 
Marine Corps are classified as either a major or less-than- 
Major ErLCgran. These two categories imply the level at 
which a nilestone decision is made. Major programs are 
designated according to their funding level and cies 
criteria, and may tke assigned by the Secretary of Defense 
(SecDef), Secretary of the Navy (SecNav), or the Commandant 
of the Marine Ceres CEC ic Department of Defense 
Instruction 5000.2 [&ef. 4%], SECNAVINST 5000.1A [ Rote 
and MCO 5000.10A [Ref. 1] 11st major progran criterragiees 
in these deSignations. Less-than-major programs are simply 
all cther misSion-essential acguiSition programs not désig- 


nated as masor programs. 


The level of hierarchy that designates a prcgram as 
Major also becomes the final decision authority fcr that 
Frogram at rilestones I, II, and III. The decision trakers 
are supported by recommendations developed by the apfprpro- 
priate review councils which convene for these three tfile- 
stones. The Defense System Acquisition Review Ccuncil 
(DSARC) andthe Department of the Navy System Acguisition 
Review: Ccuncil (DNSARC) provide program recommendations to 
the SecDef and the SecNav, respectively. Similarly, ie 


Marine Corrs System Acquisition Review Council (MSARG@) 
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Siprentse thcmenc  Ob@eall (major programs inelhding tncse 
subject to higher review. The MSARC consists of a EFoard of 
general cfficers, which is chaired by the ACMC and includes 
the CG, MCLDEC, DC/S KLES, and other major HQMC staff chiefs 
and directors. This council receives a comprehensive review 
cf the research and development concerning the acquisition 
Frogram and formulates recommendations for sukmissicn tc the 
eMC . 

The less-than-major programs Ujeesden. a Sslrilar 
review process by an In Process Review (IPR) Committee. This 
committee is chaired Ey the DC/YS RD&S and has representation 
Baoteayli Ma jomedONC start and the CG, MCDEC. The ACMC is the 
fee rsicnheauthority £cr less-than—-ma jor programs, and the IPR 
committee submits reccmmendaticns to the ACMC for the acqui- 


eileen pregram decisicn. 


T. USMC RDT&E PROGRABMING AND BUDGETING 


All research, development, testing, and analysis 
descriked aT this Chapter depend Critically on 
Congressionally~approved allocations. The estimaticn and 
submissicn cf funding requests are coordinated by the DC/S 
RD&ES for each fiscal year, and this process invclves all 
Mmurers cf Staftit and Directors at HOC. inet dai y each 
BrOgGrag Sepcrsor must submit a prioritized listing and accu- 
rate funding estimate of his respective aCe lisa ten 
Programs. The programs are then combined and subjectively 
prioritized and evaluated through a seguence of ccmmittees. 
The pregrat sponsors present each proposal before a Pregran 
Evaluaticn Group (PEG) and then a POM Working Group (EWG). 
The groups’ results are then reviewed and evaluated rricr to 
Submissicn to the CMC for aprreval. The approved acquisition 
Froyrarm funding profiles levels are included in the Navy 
portion of the Five Year Defense Plan (FYDP) and become the 


i 


Marine Ccrps’ input te the RDIGES Nee After DON, COB Sian 
Congressional negotiations, Marine Corps RDTEE funds ame 
apprcpriated by Congress as part of the RDITS= Ne budge 

A slitilar cyclic process is involved in the dével¢pmem: 
and submission cf the PMC FCM for the allocation  Cil2mee 
tor the production and deployment phase after a pcsitive 
filestone Iil decieien- Che difference betwaen the two 
processés 1S the existence of an analytic support model used 
in the EMC process andthe current absence of a supfpert 
model for the RDT&E frocess. The model used during the FMC 
FOM process was developed under civilian contract and is 
described in the final contract report, "Decision-Analytic 
Suppcert cf the USMC Program Development: A Guide tc the 
Methedelcgy'™ | Re fo. Independent of the PMC model, the 
CG,MCLTEC developed a frocess with the objective of combining 
Eany subjective judgements from headcuarters and operational 
levels tc prioritize RDT&E acduisition programs and previde 
Suggesticns in program funding profiles, however, this 


pFrocess has not teen implemented. 


Bo TEE FROELES 


Defense system research and development programs indi- 
vidually dc not possess an obvious numerical quantity that 
allows mathematically straightforward program comparisons or 
funding prefile optimizer ioen-. Inherent then tc EDaes 
Frogram and funding decisions are the personal judgments o£ 
the decision maker. tThese subjective decisions rely on the 
informaticn and analytic support available to the individual 
and Supporting staff group prior to the decision.” Yara 
Corps RDT&E acquisition programs are prioritized in uprfer 
hierarchical level ccmmittees and currently do not utilize 
Mathematical analytical decision support. The increasing 


fiscal ccmmitment associated with eaca new defense precgran 
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and the intense comfetition for scarce resources infly the 
Crlerea eilpoertance Ci PrlOELtizZation decisions. Tc ensure 
PEescieattonmore tie LeSt pregrams Lor funding allocaticns or 
to optimize the rfortfclio of programs presented will recuire 
assistance from analytical decision tools. the pricritiza- 
tion process proposed by MCDEC utilizes a model composed of 
linear ccmbinaticns of normalized subjective weights. Othker 
methcds cf multi-attribute analysis and modeis are suggested 
an the laterature £rcem industrial applications and thecret- 
ical technigues. investagation amto thes RDTSE pregran 
Prioritization process is warranted and may provide opti- 
mizing technigues which will assist the Marine Corps in 


KDT&E resource allocation and program selection. 
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Tit. LITERATURE 


A. INTRCDUCTION 


The impertance cf Research and Development (&86&D) LIne 
Frivate and governmental sectors is evident from the guan- 
tity cf infcrmation available in professional papers, jour- 
nals, and books. This chapter reviews a portion of this 
literature which concentrates on R&D project selecticn and 
resource allocation models, the suggested utilizaticn of 
these mcdels, their limitaticns, and their acceptability. 
The furpcese of this review is to investigate demonstrated or 
Froposed methods of sclving a froblem similar to that previ- 
cusly presented and should not be viewed aS an exhaustive 
study of R&D literature. 

Several published articles review a number of frofosed 
methcdclcgies and mcdels in the R&D project selecticn and 
resource allocation area. These review articles tend to 


classify aucdel forms into one of two general categories. 


Baker [Ref. 6] titled the categories as "benefit measure- 
kent" and "project selection and resource allocation." 
Winkcfsky, et al. [Ref. 7] described similar classiieae 
tions as "value measurement" and "portfolio selection." 


Benefit or value measurement models rely on sutkjective 
expert judgement for froject evaluation combined into check- 
lists, comparative froject scores, or economic indices. 
Project or portfolic selection and resource allocation 
models normally use a mathematical programming cr cther 
optimizing technigue tc maximize a benefit, such as profit, 
subject to constraints, such as budget and manpower. Cther 
articles, Augood [-2eftjeci, Geatjee t vdiee f{Ref. 9], (eters 


{Ref. 101], Newman [kef. 11], and other authors review cr 
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PEercce odclommetnat Canuape Classified into these general 
categories. Benefit measurement and portfolio selecticn will 
ke used for model classificaticn in this review. 

Scme authors, W2EhROLSKY, et al. hecho 12], 
Baker, €t al. Reis 3 |; and Allen, et al. [Ref. 14], 
propese methodolcgies for implementing series of grcdels for 
hierarchical applications. In addition to the medel and 
methcdclcgy profosal and review articles, Brandenburg 
Bretse 15), Baker [Ref. 6], Souder (Ref. 16 and 17], and 
other authcrs suggest R&D model analysis criteria as well as 


cbserved mcedel limitations and acceptability. 


Bo. RESEARCH AND DEVELOPMENT MODELS 


In addition to the general classifications of kLenefit 
measurement and portfolio selection, models are furtker 
defined Ey a common fcerm, such as an index model or a linear 
Frogramzing model, a description of that form, and _ the 


recommended or observed use of the model. 


1. Eenefit Measurement Mcdels 


Fenefit measurement models typicallv use subjective 
€valuaticn cf a number of R&D froject attributes and ccrbine 
these evaluations into a froject value or worth. These 
ceiels vate welassiiied into the cheekPist, scoring and index 


model fcrms. 
ae Checklist Models 


These mcdels are the simplest type and use 
Subjective compariscns of a project against a list of 
elements. the elements describe project criteria Or 
consideraticns, estaktlished Ly the management, that have 
some significance towards success. Augood [Ref. 8] suggests 


five general criteria subdivided into 53 specific elements. 


Cooper [{Fef. 18] surveyed 103 industrial product firms and 
was akle te analytically reduce his 48 similar elements into 
13 meaningftl factors. Augood [Ref. 8] also suggests rating 
fFrojects against the checklist elements by using descrifters 
such as very unfavoraktle, unfavorable, average, favorakle, 
and very favorable. The worth of a project 1S providedua 
cbserving the number cf criteria it meets or how "favorable" 
the project looks by its overall element descriptor ravings 
This methcd then reguires judgemental evaluations ci the 
checklist results §fer cach pregqecc. Winkofsky, et al. 
{[Ref. 7} in their literature review, observed that checklist 
models are most suitable for project evaluation in the 
explcratory R&D phase when only preliminary project inforna- 


tion is available. 
Eb. SeoOring sieges 


scoring mcdels are guantified extensions of the 
checklist medels and provide a numerical score or value fer 
each frocsect. Using a Similar criteria list as used in the 
checklist models, tke project score is typically generated 
from picducts of assigned criteria weights and preject 
values associated with criteria accomplishment. These frod- 
ucts are then summed cver all criteria to provide the final 
project score. WINkGESKY cr rau (Ref. 7] presented the 


general sccring model form as 


PV j= Sumy: (Oho) (Signe (3.1) 


where, 
a = criterion nupter, 
5 = froject number, 
PVj = jth project value to organization, 
Wi = ith criteria cr element weight, and 
Sij = jth project accomplishment of the ith criterion. 
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The weights such as hi or Sij are normally assigned by k&D 
Wanacers or R&D advisory groups based on personal cr group 
judgement. Coorer [Fef. 18] empirically derives criteria 
weights through subjective survey data and a multivariatkrle 
regressicn. Augood [Ref. 8] suggested applying the weights 
0, 2, S, €& and 10 to his five increasing benefit element 


descrirtcrs and subjectively assigning relative impertance 


weights to each element. He then represented a prcject 
score as 
Py = (100 Sum/i [ (Wi) (S1j) ])/ (10 Sum/i [ Wi }) (ore ) 


where the previous netation of eguation 3.1 is used. This 
form kounds the sccre between 0 as failure to 100 as 
success. Scoring models have keen used for project selection 
in a number of organizations, according to Winkofsky, et al. 
Bret. 7/7], With various criteria and weighting schemes 
utilized. 


c. Index Models 


These mcdels directly involve fprobability o£ 
Froject success and costs. The general form of an index 


model is; 


(eae eac ee) 
where, 
ime=- preject index value, 


P = [Icject probability of success, 
B = freject benefit, and 
c 


= cost. 


The differerces in the index models proposed in the litera- 


ture are determined ty what is included in the three nodel 


parameters. The Probability WOmeodecess nay include 
subfactcr probabilities such as success in research teem 
nology, prcducrion, and market areas. Benefits include 
items such as savings, profits, or cash flow. Costs Gage. 
from F&D investment tc total lifecycle expenditures. These 
indices may te used alone or combined into other indices to 
Frovide the final prcject measurement such as the Ansoff 
index, suggested by Winkofsky, et al. [Ref. 7] as ty pie 
cf R&C project selection indices. Ansotf's index provides a 


numerical value called the Figure of Merit (FM) such that 


FM = rdp( T+ B)E Y/Y (Total investment) (3.4) 
where, 
r= frotability of research success, 
d = protability cf development success, 
gr = prokability of market success, 
T = index of technical merit, 
B = index of business merit, and 


to 
i 


Fresent value cf earnings from project. 


Like the scoring models, the index models combine a numter 
ef prceject attributes into a single value which may then be 
used to rank projects and assist in determining efreject 
selection. More cost analysis is required for typical index 


models than is generally necessary for scoring models. 


2+ E£Getlolic Seteetion Hodels 


Fortfolio selection models are normally more conmpli- 
cated than Fenefit measurement models; however, they also 
Frovide additional flexibility and realism to the R&D deci= 
SiOh Maker, according to Souder Vekot ia Typically these 
models utilize a mathematical programming technigue to 


assist in project selecticn by providing the rescurce 
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PePocselenethiatewell faximize the benefit contributicn for a 
PeGEpCosiy bce projects. » ihe models are claSsified within 
Bieme rer ticlio selection category Dy the mathematical 
BPEOGEdMiing form used. Linear, NOt wineatwemetntegcr; = and 
dynamic prcgraming model forms have been propesed in 
literature. Winkofsky, et al. DhChsmweemonscry cd in = their 
review that these pertfolio selection models assume that an 
Pepilmert Denerit Or ccntribution function can be determined. 
They reviewed other authors, however, that utilize an inter- 
active programming mcdel form which assumes an implicit 


kenefit function exists but is never formally defined. 
a. Linear Programming 
The general form of the linear programming todel 


is 


maximize Ex (o%5)) 


surject to Ax ss b 
<x s 15 
where, 
X = n-ccmponent preject resource allocation vector, 
c = n-cogponent prcject benefit vector, 
me UXN=COMporent project resource utilization matrix, and 
b = m-comfponent available resource allocation vector. 


Linear programming ccrputations provide an optimal rescurce 
allocaticn for all prcjects provided that the values repre- 
sented by c, b, and A can be explicitly obtained and the 
assumed linear relaticnships between resources and Ltenefits 
Fortray an accurate saucdel of the usiny organizaticn's situ- 
Selon « Ine project resource allocation vector x, frovided 
Ey the ccmputations, takes values between and including zero 


and cne. Zero represents no resource allocated cn that 
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Specific froject ard aone represents full allccataaae 
Values Letween Zero and one provide the proportion of full 
resource allocation necessary for the optimal sclutiem 
Asher [Ref. 19] gropcsed a linear programming model to allo- 
cate manpower teams irvolved in the testing operaticn of new 
chemical ccmpounds under development by a pharmaceutical 
company. The project resource allocation vector represented 
the number cf tests cf a specific compound each team would 
conduct and was bounded by the total number of each chemical 
compound available. The expected return of the compound to 
the firm was used as the the project benefit vector and was 
calculated as the prcduct of the probability of succes=maws 
the estimated net market value of success for each ccmecund. 
The project resource utilization matrix was equal to the 
number of heurs necessary for each team to test a Specie 
compcurd and was based on the team's experience and skill 
levels. The resource vector was the manhours availatle for 
each tear. The computation results provided which manpower 
team should test which compound and the quantity cf that 
compcund they should test in order to maximize the expected 


value or return to the company. 
bo Non-linear Pred canned 


Non-linear programming models are very sirilar 
to the linear mcdels but attempt to represent reality as 
Non Linear «re jationehaos rather than strictly linea 
Non-linear models are formulated with similar notaticn as 
equations 3.5 and previde similar resource allocaticn  tn7an. 
mation. A non-linear benefit function has the intuitive 
appeal that as more units of resource are provided to a 


project less benefit is returned for each additional infut 


— ee ee ee ee ee ee eee 


"The bound of one was freviously noted for the tyf 
linear program mcdel. Asher's computations found the ac 
allocaticn value enstead of a froportion. 


Ze 


nee. Chidambaram [Ref. 20] considered three sefarate 
concave nondecreaSing functions; guadratic, exponential, and 
iegtbaeniiewm wnieh all approximated his U.S. Army data of 
estimated future military tenefits for a set of frojects. 
Penu@er | Ref, 16] prEOrcsead and anaiyzed four portfolio selec- 
tion todels based on similar models in the literature using 
mipety actual R&D prejects. For his model Souder used two 
mypes CL ReN-linear benefit functions which are represented 
Mmemnroures s.t and 3.2. The exponential type, Fijure 3.1, is 
PisOeesifuiar to  Chidambparam®sS benefit functions. Scuder 
suggests using this type of function when incremental 
resource expenditures in the lower x domain are expected to 
greatly increase the return, and the benefit diminishes at 
some feint as resource levels are increased. The S-shared 
benefit function, Piguie jac, was suggested for freject 
cases where success was related to a breakthrough in tech- 
nology. In this case the return from the resource input was 
initially expected to be lower until the breakthrough. Then, 
small additional resource expenditures returned larger 


kenefits until a diminishing return point is reached. 
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Figure 3.1 Exfenential Type of Benefit Functicn. 
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Pi 0ure =o. S-Shaped Tyre of Benefit Function. 


c. Goal Procramming 


Goal programming is a mathematical programming 
method which incorpcrates several objective functions as 
Organizational gcals and attempts to solve them sinultane- 
ously. The objective or goal functions beccme the 
constraints of a linear or ncen-lineark programming —~ropeem 
The pretlem's overall objective function is a compesite of 
the goal functicns which are weighted in their relative 
acconplishment importance by the program user. The comfuta- 
tion wininizes the frioritized deviations from the goal 
constraints as descrikted by the composite objective function 
and defines a rance of feasible solutions between the 
competing gcals. Gcal programming in R&D models 1S nonmauey, 
used with other mcdel forms such as in Taylor, et al. 
[Ref. 21] and Winkofsky, et al. [Ref. 12]. 


ds. Integer Frogramming Models 


Integer frogramming models are formulated ina 
Similar manner to the linear and non-linear models, however 


the project resource allocation vector is constrained to be 


30 


integers only. Ray OL ee nee [Rememect’)] wtilized an 
integer program model incoryorating goal programming methcds 
to allocate thirty researchers among seven P&D projects. 
Non-linear constraints were used to relate the number of 
researchers assigned to a project to probability of success, 
monetary return, ard project time completion. Linear 
constraints were used to describe budget limitations and 
@omeuter cdpacity utilization. A linear composite okjective 
function was used that described prioritized deviaticns frem 
€ach goal constraint and the integer program computation 
minimized these deviations to frovide the optimal allocation 
SOlUuticCn. Other authors have proposed simpler 0-1 integer 
Erogram modéls which frovide a go or no-go project decision 
dependirg on the rescurce allocation vector values cof cne or 


zero respectively. 
€. Dynamic Erogramming Models 


The first three portfolio selection nodel forms 
descrited are closely related and differ only in the tenefit 
and censtraint functional relationships and the dcmain of 
the rescurce allocation vector. Ta clealicws sLogra hii ng 
approach to R&D project selection provides a different orti- 
Mizing téchniygue with a seguential decision frocess. Hess 
[Ref. 22;} presents such an aprroach as more typical of the 
Pew Eudgeting problem than a current-cycle-only optimizing 
solution. Hess sugsests that most R&D resource allocation 
models de nct adeguately consider the periodic re-evaluation 
c£ REL projects which stem from the increase in information 
obtained during the K&D process as well as the cyclic kudg- 
eting evolution. Hess proposed uSing the mathematical 
recursive technique cf dynamic programming to develop an 
epcamdal rescurce allccation policy, an for the series of 
subsequent project resource decisions stages. The general 
recursive eguaticns fer Hess model are 
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£1(x) = max over P { R1(x,P) Jj (35 op 


for the last decision, and 


fn(x) = max over P f Rn(x,P) © EN— Vika Ws) eee (3.98 


for the nth prior decision where, 


Paes) = maximum benefit when n' decisions r2main, 

X = initial quantity “ef pesourec, 

P = policy cr series of resource decisions used, 
xn-1(x,P) = resource function of x and P at stage n-1, and 
Rn (x, P) = benefit returned in stage n uSing x and P. 


Assuming Pn(x,p) is known through some benefit measurement 
methed, the cptitai@volrcy, Po; 1s calculated Ey =i 
solving eguation 3.6 for the last decision, stage 1.) (Nees 
€guation 3.7 1s solved for n=2 with tne substitution of 
€guation 3.6 The value of n iS increased and equation 3.7 is 
solved again with the substitution of the n-1 results see 
incremental increase in n represents the next prior decision 
stage in the sequential R&D resource allocation process. The 
dynamic pregramming model 1s dependent on kncwing the 
kenefit values of Ri (x,P) (i=n,n-1,...,2,1). This frequen 
Froject information representing the entire project were 
phase and the number of cycles remaining until project R&D 
complieticn. This infcrmation is normally based on sukjective 
Evaluations and estimates which are used to derive the 
resource to benefit relationships. Gear, et al. [Ref. 9] 
analyzed several dynamic programming models similar tec and 
including Hess' model. They okserved that this form of the 
model has the advantage cf catering tc the multistage 
learning and decision nature cf R&D projects. Although this 
aspect is referenced throughcut the literature, the model 
forms presented above do not consider it as well as the 


dynllaige —roegqranninge tcure 
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f. Interactive Programming Models 


WiantKorSky, etal: [Ref. 7} reviewed several 
authors that proposed interactive programming models as 
solution technigues for multiple criteria problems. These 
models can provide helpful tocls in the R&D portfolio selec- 
Prom precess. ZOint= and Wallenius [Ref. 23] proposed a 
fan-machine interactive programming method which allcws a 
decisicn taker to crftimize an implicit benefit function 
involving multiple okjective or goal functions. The benefit 
functicn is a composite objective function and is unknown to 
the decision maker; however, it 1S assumed to be a linear 
Pumetilon, Cr ina mere general form a Concave function, of 
several knewn goal functions. The implicit composite oljec- 
pie funetion 1s maximized against a set Cr =sCch vex 
constraints through the decisicn maker's answers to yes-or- 
no guestiors involving trade offs between possible goal 
mane ticn sclutions. Zoints and Wallenius' method initially 
optimizes a computer generated composite objective function 
gncludinc the goal function constraints and an arbitrary set 
et iLuncticr multirfliers. The technigue produces a 
Paretc-Optital soluticn to the problen. Next a subset of 
nonbasic variables is generated that, if introduced into the 
Basis, would continue to yield a Pareto-optimal solution. 
For these selected variables a series of trade offs are 
defined which increase or decrease each of the gcal func- 
tions and the trade ofrfs are presented to the decision 
maker. The decision maker's responses to the trade offs are 
used tc generate a new set of goal function multipliers. The 
hew Multipliers develop a new composite objective function 
SeOSe€r tc the implicit function. The authors state that 
Successive iterations of this frocess assures convergence to 
the Pride SOLUL ICN. Their premise is that all 


Pareto-oftimal soluticns form a subset of all extreme foint 
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solutions and with each iteration a Pareto-optimal solution 
is eliminated from the set of possible optimal solutions. 
Since tkerée is a finite number of extreme points there will 
be a finite number of iterations reguired to oktain the 


optiza] sclution. 


- Co. (RECT SICN PROCES a 


The rajcrity of models presented in the literature are 
propesed for or utilized in single level orgéanizapioes 
Several authors have proposed extending these model forms 
into méthcdclogies or decision processes for use by gulti- 
level Cr ganizd tl Olee Baker, et al. [ Reha and 
Winkofsky, et al. [Ref. 12] presented such processes. Both 
articles concentrated on budget allocation of R&D dcllars in 
a multilevel organization and relied on the interlevel 
communicaticn and interaction to complete the frecess. 
Win WOfSKky,. haa. [Ref. 12] proposed a decision process 
model in which many subunits within a three level organiza- 
tion are considered. Each unit attempts to minimize the 
deviatiors from its 0-1 goal constraints. The lowest level 
formulates and solves its goal program and provides’ the 
resulting sclution tc the middle level. The middie level 
formulates a goal prcgram incorporating all subordinate yume 
program results and additional constraints from the bhigues 
level. In turn the higher level solves a composite goal 
FLOgrar 1ncorpolating wm aide. level results. Contlvem 
ketween the levels are resolved either through communication 
rketween levels or, if necessary, as directed Ey higher 


levels. The process iterates to an optimal solution. 


EE. ANALYTIC HIERARCAY PROEESsS 


Saaty [Ref. 241 proposes the “Analy tae Hieranenmy 


Process" (AHP) as a decision tool for determining pricrities 
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and making trade-offs. Saaty provides many possible arrplica- 
Pieme et Ouments == trOcess Of wWinkch RSD resource allocaticn,is 
cone. Price ttGtngmanmlerabchy Of criteria stake- 
holders and outcomes and Ey developing judgemental tLased 
priorities the process contributes iiecouolex i p,rchler 
Pe vingewah@mredicticns Of lakiy Outcomes. AHP uses three 
pEerncipals Of analytic thinking; structuring hierarchies, 
Pomurnigucbwobleltes, “and dogical consistency. AHP enables 
consideration of a froblem as a whole and the study cf the 
component Interactions “within Mere rbakGnica | preoblen 
description. Saaty describes an eliyht step process which 
encompasses a graphical breakdown of the problem into a 
decisicn tree hierarchy, involves pairwise criteria ccmfari- 
sons, estarlishes decision friorities, and evaluates the 
consistency of the ccmparisons. Figure 3.3 shows his examrzle 
hierarchy structure for choosing R&D projects to ensure 
adequate future power and electricity. The figure lists s1x 
levels of hierarchy, one focus or central objective and the 
remaining levels each with several elements. The process 
involves a pairwise comparison starting from the tor. A 
higher level is used as the comparison froperty for the next 
lower level. The pairwise comparisons of the elements under 
a property recome the basis for the computation of relative 
element priorities. Finally, the consistency of the ccmfari- 


sons is investigated. 


Fe MCYTEL ACCEPTABILITY AND ANALYSIS 


The acceptability of R&D project selection models by 
industry and government has leng been a problen. This is 
€vident fren statements in the majority of articles 
reviewed. Baker [Ref. 6] lists seven limitations of frorosed 
R&D models based on his’ and others' research. Baker's 


Summary cf K&D model limitations is as follows: 
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1) Inadéeguate treatment cf ROject. and arameter 
Pieoere ld tVols With Fespectato Doth benefit con tribution 
nd to resource utilizaticn. 
) 
e 


Inadequate treatment of uncertainty as it impacts in 
nefit mé€asurement and parameter estimation. 


} Inadeguate treatment of multiple, interrelated deci- 
Sicn criteria which have no underlying measure. 


4 Inadeguate treatment of the time variant Chea of 
the parameters. and criteria and the associated froblen 
of centinuity in tke research program and staff. 


5) A restricted view of the problem which (a) portrays a 
oncé-a-year investment decision rather than an intermit- 


Bent streams of Investment alternatives,  ({b) does not 
mc lUdCC McUGnhE atcrloutecsuweas Clming of the decisicn, 
genération of additional alternatives, and recycling, 


fey Ges Weemneececgnize the diversity of projects alcng 
the spectrum from Fasic research to engineering, and ({d 
Views the problem asa decision event rather than a 
hierarchical, diffuse decisicn frocess. 


6) Nc explicit recognition and incorporation of the 
impertance of individual R&D personnel. 

oh Tice iINabiiityecOwestdclicnn and Maintain balance in 
the R&I program; e.s., balance between basic and afplied 
research, between offensive and defensive research, 
between Ereakthrouch and improvement $$ crientations, 
between in-house and |. contracted projects, between 
prodtct and process oriented projects and between high 
risk/nigh payoff and low risk/moderate payoff projects. 


Baker ccntinues with the conclusion that this list cf limi- 
baunlons takes it clear why few R&D models have been imple- 
mented fcr use Ey FED managers and, in the cases where 
models are utilized, the majority are the simpler scoring or 
index form. 

Souder [Ref. 17] developed a scoring mcdel to assess the 
Suitability of R&D mcdels. His criteria used for the mecdel, 
Fased on hig interviews with management scientists and R&D 
administratcrs, are fresented in Table II. Souder then used 
his sccering model tc rate 26 nedels for use in R&D project 
selection decision support. Index and scoring model forms 
were again found tc be in greater use than other todel 


forms. 
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This chapter has reviewed 


model forms found 


Fresented were typical 


through out the literature. 


TABLE a 


Five Model Criteria and Their Characteristics 


model includes: 


Multiple Objectives 

Multiple Constraints 

Market Risk Parameter 
Technical Risk Parameter 
Manpower Limies = Parameres 

faq. Parameter 
Budget Limits Parameter 
Premises Uncertainty Parameter 


model applicable to: 


Applied Projects 

Bas iC Pro gceece 

PELOLity. vecisSions 
LeLMination PecrsrEens 
Initiation Decitsteop se. 
Budget Allocation pep Lice ee 
Pro ject Funding epi resteaon 


models performs: 


Multiple Time Period Analyses 
Optimization Analyses 
Simulation Analyses 
Scheduling Analyses 


model is characterized by: 


Familiar Variables 

Discrete Variables 

Computer Not Needed 

Special Persons Not Needed 

Special Interpretations Not Needed 


model has: 


LOW Set-Up §Ceses 

Low Personnel Costs 

Low Computer Time 

Low Data Collectien Gesu 


| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
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several R&D project selection 


The mcedels 


of the literature and were the more 


38 


(atemdimerorlouwumen CCuld haves, application in the follcwing 
analysis. The commcnality okserved between model forms is 
the use cf subjective project benefit relationshifs in scme 
manner. Decisicn frocesses and the Analytic Hierarchy 
Froces¢ were briefly presented as methods for aprroaching 
the R&D freject selection problem. Table III sunmarizes the 
models presented in this chapter. Other proposed project 
selection models are listed in the Diot res rami. The next 
chapter describes a R&D program prioritization precess 
Froposed within the Marine Corps, and classifies the precess 


model fcrm according to the literature. 
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TABLE Die | 


Summary of Kéeviewed Models and References 


Auther/Reference Model Form Descriptor Used 
Asker oe Iinear Programming 
Pehiei se. uses 
Augood (1973) Checklists 
Pei. GS Simple _ 

Uanetlived 

rofile 

Indices 

Baker sere Fenerit Measurement 
(Ref. 6] Comparative 


3 conrad 

Benefit Contribution 

Froject Selection/Allocation 
Ranking 
Linear Programming . 
Non-Linear Programming 
Dynamic Programming 
Integer Programming 


am (1970) Nen-laneae 


tha, 

.m 
=} 

hor 


98 1) Bnpitical (scorria 
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Dynamic Programming 
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etal. 6(1992) Integer Nen-linear 

ae Goal Programming 

ky et al. (1980) Value Measurement 

i Checklist 
SCO 
Economic Index. 

Fortfolio Selection 

Linear Programming 
Integer Programming 
Nonlinear Programming 
Interactive rProgramging 


et al. (1981) 0-1 Goal Programming 


ai. (e726) Interactive Programmirg 
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mvc MCREC PRECHRITIZATION PROCESS 


oe ee ee ee ee SS Se a Se ES 


A. INTRCDOCTION 


The MCDEC Prioritization Process consists of four tile- 
dependent phases synchronized with the Marine Corps partici- 
Fation in the DOD Planning Programming and Budgeting Systen 
and is crganized fcr implementation at the Marine Corps 
Develcpment Center (LevCtr) , MCDEC. Figure 4.1 depicts this 
synchronization and the process timetable for a single 
evycle. The four phases include determining deficiencies 
and requirements, frioritizing deficiencies and regquire- 
ments, prioritizing research and development progrars, and 
Sompleticn cE fundine profiles. This process, as descrited 
Dyetajon J. L. Creed, USMC, in “A Guide for the Performance 
of the Development cf the MCDEC R&D Program Prioritization 
Frocess, Methodology Manual" [Ref. 25], is carried out under 
the responsibility of the Office of the Deputy Chief of 
Beatt {LC/S), Developmental Coordination (DC), #£DevCtr, 
MCDEC, and ty two prigary grourfs, the Prioritization Werking 
Group (FRWG) and tte Chief of Staff's (C/S's), DevCtr 
Frioritization Committee (Pri Com). Each Divisicn and 
Directorate of the YevCtr ,rovides a representative for 
membership in the PRUWG. The Division and Directorate Heads 
sempcse the C/S5*s DevCtr Prioritization Committee. Appendix 
A details the phases and tasks of the process and lists the 
TevCtr Divisions, Directorates, and Develcpmental 
Coordinaticn Branches responsitle for completing each ster. 
This chapter describes the process concepts and concentrates 


on the participants as shown in Figure 4.2 . 
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Figure 4.2 MCDEC Process Participants. 


Bee FROCESS PHASES 


The determination of deficiencies and r2equirements, 
Fhase I, involves three general tasks and serves to frevide 
the PRWG with an infcrmation base for the following sukjec- 
tive evaluations. Picks ty, the Marine Corps Midrange 
Objectives Flan (MMROF) and the Marine Corps Long Range Plan 
(MLRE) are updated utilizing Defense Guidance (DG), the 
FYDP, previous FOM recommendations, and other appropriate 
research and development information. 
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Seccnd, Ficeet Marine Forecemm@ input 1s sclicie@ 
ty survey analysis through questionnaires, opinionnaires, 
and perscnal interviews. This task provides the evertual 
system users with an opportunity to input observaticns of 
missicn deficiencies, ideas for new prograns, and their 
rankings of ongoing [regrams. 

Finally, MAAs are conducted which provide the frame- 
work necessary for phase II and serve to formalize all defi- 
ciencies that diminish the capability to perform the mission 
area. The MAAS are classified according to the Missicn Area 
Flements (MAEs) listed in Table I, and performed by prceject 
cfficers under the direction of the Planning and Evaluation 
Franch, DevCtr. The assigned project officer conducts his 
analysis through a series cf mission categorizaticns which 
are kased on the previously updated plans and other estab- 
lished Marine Corps Pecctrine. Three basic categorizaticus 
cccur during the MAA. First, the mission area element is 
defined intc its general and specific operational missicn, 
then the resources necessary to accomplish the oferational 
missicns are identified, and finally each resource is 
analyzed against each operational mission to identify if any 
deficiencies exist. The ccllection of these identified 
missicn deficiencies present the recommended corrective 
actions to cbtain full Marine Corps capability in a @YSSien 


area. 


Fhase II mercées the identified mission element defi- 
ciencies into a single prioritized list” To accomplisieaiee 
ranking, the PRWG first receives briefings concerning the 
MAAS and survey analyses from phase I. Next, the PRG 
constructs a decision tree based on tne presented inicrma- 
tion to order deficiencies within mission area elements. 


The tree development is represented by Figures 4.3 through 
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4.6. This development parallels the mission element categcr- 
izaticrn frecess conducted during the MAAS and applies multi- 
attrikvte utility analysis to the categories as explained by 
Creed [Ref. 25]. The subseguent evaluations of the elements 
and missicns, refresented by the decision tree branchs, also 
rely heavily onthe MAAS as fFresented to the PRWG by the 
project cfficers, and by the Planning and Evaluaticen Branch. 
Additional technical assistance for the decision tree 
constructicn and analysis is provided by the Analysis 
Support Eranch. 

The decision tree is EFased in the USNC misSicn areas 
and elements listed in Table I and is represented in Figure 
eS The tree branches through the doctrine based general 
and specific missions for each element (see Figure 4.4), and 
then these specific missions are shown supported Ey the 


MecesScary LeSOUurcesS, aS presented in Figure 4.5. 
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USMC AISSION 


Mission Land Warfare Air Warfare ete. 
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i 
as - 

Mission Clase Fire Ground Mine Land Land ° ° 
Area Combat Suroort Air Wasfare Combat Combat 
Elements (211) (212) Defense (214) Supnort Service 

(213) (215) Supoort 


(216) 


Kote: See Table J 


Figure 4.3 Tecision Tree, Established Base. 
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Figure 4.4 Decisicn Tree, General and Specific Missions. 
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Figure 4.5  Decisicn Tree, Resources. 


The resources shown in Figure 4.5 are further 
defined into principal and ancillary categories. Prine@imee 
resoures ccrresrend tc eguipment or weapon systems that are 
used to accomplish the specific mission directly, and 
ancillary resources are necessary but only indir ecu 
Suppcert the mission. A common list of resources necessary to 
accomplish the specific operational mission 1s initiaee 
applied to all specific operational missions with scme 
resources subsequently being determined not applicakle for 
all missions. As an example, Creed {Ref. 25] suggests a 


possitle resource list for the close combat missicn area 
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Figure 4.6 Decision Tree, Deficiencies. 


€lement to te direct fire, assault, and anti-armor weapcns 
for the principal rescurce category and communication eguip- 
ment and target acquisition devices for the ancillary 
resources. The resource deficiencies and, thus, the mission 
deficiencies Shown in Figure 4.6 are identified by evalu- 
ating €ach resource as it Supports the accomplishment of the 
specific operational rission. 

The PRWG assigns subjective importance values? (0.01 
te 1.00), to each kEranch of the decisSion tree from the 
Missicn area through the deficiency level. These values are 
Fased on presented information and finalized through collec- 
tive group judgement. The Mission Area Values (MAV) repre- 
sent the relative impertance of each mission area within the 
USMC missicn and tke Mission Area Element Values (MAEV) 
represent the relative inportance of each mission area 
€lenent within the mission area. Similar ly; General 
Cperational Mission Values (GOMV), Specific, Operational 
Missicn Values (SOMV), and Deficiency Values (DV) represent 


the relative importance of each general operational mission 


3These yalues refresent linear relative in 
a .74 deficiency is twice as critical as a .37 


4] 


within tke masSicn area element, each specific operational 
Missicn within the ceneral oferational mission, and each 
deficiency within tke specific operational mission respeéec- 
tively. The initial value sets, MAEV, GOMV, SOMV, and CV, 
are ncrmalized to a common tase for each set which allow 
compariscnsé across ali elements, missions, and deficiercies 
in their respective decisicn tree level. The Deficiency 
Relative Importance Weight (DKIW) for each specific mission 


deficiency is defined as 


DRIW = MAV.© MAEY [© GONVY -« SCH een, (4.1) 

where, 

MAV = MisSion Area Value, 

MAEV = Mission Aré€a Element Value, 

GCMV = General Operational MiSsion Values, 

SCMV = Specific Oferational Mission Values, and 

DV = Deficiency Value. . 
The [RIWs, in turn, determine a mission deficiency rank 


CEGCLING. 
3- FEhase 111 


Fhase III frioritizes ongoing RDT&E acauisition 
Frograns through presentation of the prioritiza tion ieee 
and ccmmittee with available information, assigning program 
subjective values, deriving program effectiveness, ccmbining 
previcus prcgram pricritizations, and presenting the results 
for DLirecter,  DevEtr approves. First, the PrioritiZzdauuem 
Workirg Grcup receives briefs by the Developmental Project 
Cfficers (PPOs) to assist in determining the worth and 
Utitwty of the progran. Next, survey analysis briefings 
Frovide the FMF evaluations of current RDT&E projrams. This 
information presented in the FRNG briefs is alsc frovided 


separately to the DCyS DC Prioritizatioa Committee. 
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The next task of phase III is the subjective priori- 
PEC iC men Ol st eDnOjJLAMSsmuseUGing this task, (a sample of 
experts are solicited for their desired RDT&E program rank 
G@eeEINGS ang retative worth values (J.01 to 1.00). This 
Seumecn SsdtipiewCONSists cf the DC/S DC Prioritization 
Committee membership, wrinimally, and may include other gqual- 
ified individuals. MThe prioritization is performed usinrg an 
analytic Delphi frocess where the independent rank crdering 
and werth values aré combined and returned to the sample 
membership for study and resukmission. After at least three 
replications with relatively common consecutive listings, 
tne fricritization ccncludes with a program ranking and 
Frogram Subjective Evaluation Values (SEVs). 

Following tke Sukjective evaluation theme RD ios 
Frograms aré€é prioritized based on their mission deficiercy 
effectiveness. The FRWG identifies all deficiencies within 
€ach pwissicn element that are directly affected by a PFDI&=s 
BeOgLan, and it evaluates the proportion at which the 
program acccmplishes the specific deficiency. TALS proper- 
tion 1s defined as the Program's Propcrtion of Deficiency 
Accomplishment (PPDA). The evaluation process’ relies 
heavily cn the input from the (POS concerning each fregram's 
Proposed operational characteristics. The product of the 
specific DRIW, assigned in phase II, and the specific PPDA 
are summed, over all deficiencies, to obtain a pregran 


Deficiency-Derived Efficiency Value (DDEVY) as 


DDEV = Sum/d [ (DRI) e(PPIA) ] (322) 
where, 
Sum/d = Summation cver all deficiencies, 


BRIM 
mee EA 


Teficiency Relative Importance Weight and 


Frogean' S Proper tron ofr Deficiency Accomplishment. 


The pregrams are then ranked according to the DDEV values. 
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The PFRWG oktains a final RDT&E program rankinouey 
combining the subjective and deficiency-derived pricrivtiagae 
TOTS: A Subjective Evaluation List Weight (SELW) and a 
Deficiency-Lerived List Weight (DDLW) is assigned to the 
appropriate program list combining them ina iinear temas 
tionship bFased on PKG consensus of each Jlist's validity. 
The sua, by progran, of the weighted prioritized lists 


Frovides the Final RII&E Program Value (FPV) as 
FPV = (SELW)¢ (SEV) + (DDLW)¢(DDEV) (4.3) 


where, 


SELW = Subjective Evaluation List Weight, 
SEY = Subjective Evaluaticn Value, 
DDIW = Deficiency-l[erived List Weight, and 


DDEV = Deficiency-LTerived Efficiency Value. 


The final prioritized ranking is accomplished 1ccordipauiee 


the FFV and this comrletes rfhase III. 


4. Ehase IV 


Fhase IV completes the annual process by summarizing 
the three preceding fhases and proposing funding frefiles 
which reflect the pricritized program ordering. The frecess 
summary is used as a turnover file for the next pricritiza- 
tion cycle and the funding frefiles are submitted to HCMC 
for utilization in tke RDT&E FCM development process. Creed 
[Ref. 25] suggested further development in this phase which 
has not yet taken place. Currently, these funding prefiles 
are developed based cn solely the judgement of the tasked 
CevCtr Lranen using no mathematical optimizati cnee 


alqoritinrs . 


a) 


Suen Cr MOper IN MCDEC EROCESS 


throug nhcuewtne Literature, aS reviewed in the frevicus 
Craptet, andewin tne following analysis tne form of a budcet 
allocaticn and program selection model is important. The 
MCDEC mocdel as descrited is a benefit measurement, sccring 
model. As with typical models of this type, the MCDEC model 
combines various attributes into a single value. Weal Gea 
this mcdel form classification differences in sukjective 
kenefit weight assignment schemes are observed. These 
differences range between weight assignment by a single 
Ianager to assignment based on a multivariable regressicn cf 
subjective frogram evaluations from many solicited sources. 
The MCDEC process attempts to base its benefit weight 
assignment on many inputs fron operational ano nen 
cperaticnal forces as well as agencies cutside of the Marine 
Corps. The inputs are combined into benefit weights througn 
a grcup ccnsensus preccedure. In general the MCDEC pricriti- 
zatich frocesS 1s Sintilar to R&D project selection mecdels 
Fropesed in the literature and is classified with the 


Majority of implemented models in industry. 


De. SUMMARY 


This chapter has presented the MCDEC prioritization 
Process as described by Creed [Ref£f. 25} and by infcrmation 
obtained through liaison with the process developing agency, 
Mme nadlyslS SUprort Eranch, DC/S DC, DevCtr. The process 
emphasizes synchronization with the Marine Corps participa- 
tion in the DoD PPBS, and utilization of R&D program evalua- 
tion input from many organizational levels. The process 
requires several sukjective evaluations concerning the R&D 
Frograms and mission deficiencies which are then combined 
iieo a basis for R&C program ranking. Table IV summarizes 


the subjective parameters necessary for the process. The 


Det 


chapter concludes with classifying the model form used in 
the MCDEC process asa benefit measurement scoring model, 
according tc similarities with proposed nodels in the liter- 
ature.The literature suggests other model form applications, 
model lanitations, and model evaluation criteria which will 
assist further investigation cf possible improved alterna- 


tives cr enhancements to the MCDEC prioritization process. 


TABLE Sy 


Subjective Model Parameters 


| | 
| 
| 
| | 
| PHASE JASK PARAMETER ASSIGNMENT RANGE 
| ae 3 MAV FRWG OF Ola 100 
ap 3 MAEV PRWG Or Ora. 
| it 3 GOMV PRUG 0.01-1.00 | 
eT 3 SOMV PRWG Oca mleso ) | 
Ti 3 DV FRWG O20 ta 00 
Dick 3 SEV PLia com 0.01-1.00 | 
iT 4 PPIA PRWG O20 lle | 
er 5 SELh ERWG NS 
| ae 5 DDL’ FRWG NS | 
NS = Not Specified . 
Tasks are detailed in Aprendix A 
| — 





Ve A MCDEC PORTFOLIO SELECTION MODEL 


ee NT RCDUCTION 


The MCDEC precess presented in the previous charter was 
identified as a benefit measurement scoring model with 
Similar characteristics as models currently used in 
industry. ‘The literature also proposes portfolio selection 
models which use benefit measurement relationships to cpti- 
rize resource abeeaviOnw. tnlolg p various mathematical 
Frogranrting techniques. The MCDEC process, as proposed, 
does not attempt to optimize frogram resource allocation 
end, thus, the obvious first process improvement tc be 
investigated is the extension of the current model intoa 
portfclic selection mcdel. The simplest and most comprehen- 
dable way This can ke accomplished is by formulating the 
Frocess aS a linear programming model. This mcdel fern 
approximates resource and benefit relationships with 
straightfcrward linear functions that are easly understocd. 
The linear programming model is the basic structure for 
cther gore complicated portfolio selection models and wili 
provide a kase for okserving advantages from a process nodel 
change. The primary purpose of the following linear pregran 
development is te illustrate the feasibility, flexibility, 
and reguired assumpticns of a portfolio selection mecdél as 
applied to the MCDEC prioritization process and does not 
include allconstraints and relationships reguired fcr a 
complete RDI&SE funding allocation. 


PB. FCRMULATION 


Diewinitvoe Stet Of any linear programming formulation 


can ke viewed asa thought exercise. In this exercise the 


a 


linear program 1s viewed as a black pox which provides an 
output when given the necessary data. The tnoujyht exercise 
defines the desired outout and the remaining forrulation 
structures the linear program to obtain this outrfut. The 
currently proposed MCDEC process output provides a ;riori= 
tized pregram listing based on relative program importance 
in acccm@ylishing mission deficiencies. aA linear programming 
cutput which represents the proportion of a program that is 
selected or furded frovideS program prioritization and, 
additicnallyv, resource aliocation dutormma tone 

The next formulation step is to define index ncemencla- 
ture for the element categories under consideration in the 
linear frogran. The MCDEC process concentrated on two 
€lements, mission deficiencies and RDT&E programs. These two 
are alsc used in the following linear programming model 
formuiat toms. The indexing letter 1 will represent a 
Frograrn andthe letter j will represent a mission defi- 
clency. Also, when considering a resource allocation 
Frocess several time periods are normally necessary. the 
letter k will be used to index a time period in the formula- 
tion. The total number of programs, deficiencies, and time 
pericds will be represented Fy the) letters mr amen and t 
respectively. In the following discussion the series summa- 
tion of any indexed values wili be denoted as Sum/index 
[indexed values] such as Sumyi[Xi], which represents the 
Summaticn ci the valves Xi over i= 1...p, where f¢ is the 
total nunrber of programs under consideration. 

The benefit measurement output data provided Ey the 
MCDEC precess is defined in the previous chapter and is used 
here for the linear frogram formulation. Four value sets of 
interest are developed in the MCDEC process. The Deficiency 
Relative Importance height (DRIW) is established in fhase 
II. In phase III the Prioritization Working Group devenoee 


the Fregran's PrOLer tiene & Deficiency Accomplishment 


(PPDA), and the Subjective Evaluation Value (SEV). these 
three values are ccmbined in eguations 4.2 and 4.3 to 
provide the Final RDI&E Program Value (FPV). Resource data 
is net defined in the current process but 1s considered 
during Project Develcyment Cfficer briefs to the pricritiza- 
tion grcup and ccmmittee. The resource data is also used in 
phase IV to provide suggested RDT&E,Navy POM input. Previcus 
FOMS that are independent cf the process are used aS [roxy 
resource estimators for illustration in tress 2 cll cwing 
Lor mulaticons. 

The decision variables for the formulations are implied 
from the desired outyut. The following series of linear 
programs will be fornulated using the decision variable Xi 
which represents the proportion of the ith program that is 
funded or Xik which represents the proportion of the ith 
Frogram that is funded in the kth time period. The values 
Xi and Xik are defined between and including zero and one. 
A variakle, Yi, which represents the proportional deviation 
from a fixed jth deficiency accomplishment goal is used in 
later linear programgting fcrmulations andis also defined 
Fetween and including zero and one. 

As in the literature, the objective functions for the 
follcwing fcrmulations are prcevided from the benefit meas- 
urement model. LOmeUlcmminiticue linear program formulation 
the Final Program Value (FPV) vector from the MCDEC precess 
is used. This vector represents a combination of deficiency 
derived and subjectively assigned mission deficiency acccn- 
plishment frogram values. The vector FPV contains a value 
FPVi for e€ach progran, where i1S an integer frog 1 to p. 
Formulation 5.1 provides an initial unconstrained linear 
Frogramfing model that is equivalent to the MCDEC benefit 
measurement model and can tre solved by observation. This 
linear program waxinizes the total relative program imper- 


tance aS individually defined ky each FPVi, reduced by the 


aS 


available fprograg funding proportion Xi, and summed €ver wae 
programs. The optinal sclution for this fornulaticnae 
obtained when Ki is sét at one for all i. The initial ferme 
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maxipize Suma (Pe Vai jer (5 9 
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Formulation 5.1 may be trivial but it provides a ~laaea. 
Frogram structure eguivalent tc the MCDEC process which can 
Ee censtrained “by Budget or deficiency relaticnshiees 
Formulation 5.2 provides a constrained versicn of [LonpmuaaS 


tLOD. os.) as 


maxigzize SUN aig( fev 1) ) a (5 
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where, 


FPV1l = ith final pregran Value, 


el = proportion of ith program =tunmdcay 

Bk = available budget resource in time perioi k, 

Aki = full funding level of ith program in time rfericd k, 
Pp = number of prcgrams, and 

t = number of tine periods. 


If Bk is greater than or equal to Aki, summed cver all 


Frograms fcr each time period, the optimal solution age 


ne 


Eommlatlcnmomcun ls also at 42 equal one for all i. This 
formulaticn, however, will provide a tool to observe the 
cptital allocation change when the budget level Bk is 
reduced, thus ccnstraining the objective function. The new 
Pied ep hOuratempmmerity lastingew2ll not necessarily be the 
same as the ordering provided by FPV. After the linear 
Frograz computations, the vector (FPV) (X) represents the 
Beeoortichal ceduction in the programs" Fanal Program Value 
and provides the revised priority listing under Eudcet 
constraints. 

Fermulation 5.2 is illustrated by an example. Tactle V 
lasts the benefit measurement output values from four P8DISE 
programs considered during a partial MCDEC process test 
conducted Ey the Develcpment Center. The respective budget 
melGcatiChmedata £rom) the SRDIEE POM is also listed. A 
constant is imbedded into the linear program forgulation 
which defines possible budget reductions and thus a tighting 
cf the ccnstraints. The constant is added by replacirg the 
rkudget ccnstraints of formulation 5.2 with 


sum 7i ff (Aki) (Xi) ] + BR{Bk) < Bk . (543) 
where, 
BR = Eudget reducticn proportion. 


Eight frogressivly reduced kEudget conditions are used in 
mits example. 

Table VI lists the resulting optimal solutions and rank- 
ings for each of the eight Ltudget conditions. The fropertion 
cf full funding for each project changes but not as the 
meoeC PLIOLItizing vector FPVY implies. Although the FPV of 
Peegiam CO020 is larger than the FPV for both programs C0021 
and C0082, the latter two programs are fully funded at each 


rudget reduction. Tke values of FPV alone would not suggest 
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TABLE a 
MCDEC Portfolio Selection Model Example Data 


Pregram PPV Budget Data 

iene yr 2 Vrs yr 4 Vie 
Cumi2 0 7232464 4747 20€74 9176 Syed § See 
CO02Z0 6.9 Gale 21100 22208 30108 33700  JUsum 
CO02 | qo 79725 4172 4297 4369 4268 3328) 
ews 2 U52198> 361 370 380 442 44s 
Budget Sum =Bk= 20380 4774 1 44025 47397 @€283%e 
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these funding reducticns. For this example, observaticn of 
the differences in the programs’ budget profiles as listed 
in Takle V would imply that the optimal funding in a budget 
constrained problem weculd ke obtained by reducing the mcst 
expensive program first. However, in a larger example the 
cptina] sclution may not be as evident. 

Formulation 5.2 can be expanded to include a time index 
for the funding prorertion variable xX. This expans@enmeee 
formulated as 


maximize Sum/k [Sun/i (FPVi) (Xik) ] (5 a) 


sukject te 


Sum/i [ (Aki) (Xik) ] + BR(Bk) < Bk 
OSs eae 


1. =) ieee 
keses ecm 
where, 
BR = kEudsget reduction propertion, and 
Xik = proportion of ith program funded in the kth pepaede 
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The data values for FEVi, Aik, and Bk remain the same aS in 
for milat lon 5.2 Ecrnulav@ones.4  Drovides greater <rtlexi- 
bility in funding level possibilities and provides a 
sequence of program rankings fcr each subsequent year. Table 
VII provides a summary of the funding proportion scluticns 
and the ranking acccrding to the vector (FPV) (X) for each 
year and tudget condition. The most expensive program C0020 
is again the only frogram that requires less than full 
funding except in the most extreme condition where pregran 
G@iv2 is also less. ODSeEVing@seethe preportional funding 
pegelle cr program C0020 implies that the first time feriod 
is the most Eos trictive | in each budget COndi tren. 
Considering funding levels in each time period allows a 
greater utilization of resources available in the less 


restrictive periods. 


TABLE VI 
Forgulation 5.2 Solution Results 


| 
: 
ee ciceees One Ll be sawaget | 
eee) 9S s 5 - 90 OS - 80 BTS 50 | 
Vector X 
eel 2O X17 1.0 71.0 1.0 1 es 0 1 On 1s 0 chy | 
moO eZ ole) 1.9759 #1892 - 784 Oe Deen 2 0.0 
SoZ I Xs 1.0 1.0 li ae lee SO men te 0 lieed 
Soce2 x4 77.0 1.0 leo lac too les 1 0 ero | 
eee 5 0 Ome Ot Oe Se, rls we Oe 52 3 oo 
Ranking | 
C20 1 1 1 1 1 1 1 1 | 
CO0C20 2 2 2 Z 3 4 4 Gg | 
O02 i 3 3 2 3 C 2 Z 2 
CO0E 2 4 4 4 4 4 3 3 . | 
Notes 
1. X = Proporticn of prcegram funded and is specific | 
: EOLCCaACHOmagcet reduction Case. 
Zeke se GOpOLtion of budget reduction. 
Seeranking 1S according to the vector (FPV) (xX). | 
an ee B ae, Se ae | 
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; 
| 
| 
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TABLE Vea 


Fornpulation 5.4% Solution Results 


page tee cf Fugibeeueget 
2 25 ow oo Eo 


i | 
| 
| 
| ! 
| 
VO ae —f/3 50 | 
Xik Matrix 
Leet 20 | 
| “yrl=5 12.0 “Slee 1.0 1.0 10 1.0 [ieee 92a | 
C0020 
yr 1 1.0. Wea? Sac ~ 7/84 -677 4.57 @h6 27> 
| 2 TsO) Soo See 7 -854 ~/80”./707 76349 "22 
3 120) ie SOS ~ oo -/89 ./19 .04o 3 
i 4 120" 25-98 3 ee 4 - 881 -821 .762 ./02 00s 
| S 1.0) 936 Weg Zs « 856 7/84 .712 .640 Zen | 
CoOC27 
Ve See CO ee 1.0 1.0 15:0 1.0... 120 120 | 
COCBZ { 
VE 1.0 ele U a0 mo 10 1.0 SteO 1.0 
DR es OO een O) | OS - 10 sole - 20 a2 50 ! 
Ranking | 
Gili) 1 1 1 1 1 1 1 1 | 
C0020 Z 2 2 Z 2 2 3 * 
C0021 2 5 a 3 2 3 JE Z 
COC82 4 4 4 4 " 4 4 s 
Notes . | 
1. €1120 is funded at .92 £Eor Year one ony Janae 
1.0 for the years™two througiezrye. | 
ze Xik = Proportion of pl odean funded and is specific] 
for each year and Eudget reduction case. | 
3. ER = PYOportion Of EUCget Ge uct on- 
4 pence 1S according to the vector 
(FEV) (Sum/yr (X))- 
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The Final Program Value (FPV) provided by the MCDEC 
process as a benefit peasurement is postulated to represent 
the relative prcegranat importance in accomplishing mission 
deficiencies. The primary purpose or defense systems acgui- 


Sition and Marine Ccrps RDT&E as presented previously in 


Chapeers. Li, is the accomplishment or alleviatichie. 
mission deficiencies. Concentration on a portrfolic Selees 
tion model which considers only the FPpV and kEudcet 


constraints may net produce solutions representing the 
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Geeatest aGcolpltonment Of ~2ndividual mission deficiencies. 
ievemnextetcwempEoposed EOrmulations consider misSicn defi- 
MienecyeaccocTpirsnment in termS of other MNCDEC output values 
Upder serarate censt Laining conditions. Methird -addarional 
formulation concentrates directly on the number of deficien- 
cies alleviated. 

PoemimilatiOiue5.o. Optimizes ata level in the MCIEC 
kenefit measurement model where each deficiency is censid- 
ered indivicuailly. The FPV is constructed from the previ- 
cusly presented values of SEV and DDEV. Tre pIEy directly 
considers each deficiency where the SEV is the sukjective 
€valuaticn of the RDTEE programs only. Equation 4.2 defines 
the vectcr DDEV as the product of the Deficiency Relative 
Importance Weight (rEFIW) Midmeeche AerEOgral Properticen Of 
Teficiency Accomplishment (FPDA) summed over all deficien- 
cies. Letting the vector PPDA be linearly reduced by the 
funding proportion of the respective program provides a 
means tc cptimize the missicn deficiency accomplishment 
directly. The linear program to maximize the RDT&E program's 
CDEV is formulated as 


Daxamize  Sum/i [ (LELEVi) { Xi) 7 (So) 


or eguivalertly, 
maximize Sum/i [Sum/j [ (DRIW J) (PPDAjJi) (Xi) J] 
suk ject tc 


Sum/i [ (Aki) (Xi) ] + ER(BkK) < Bk 


Os Xian) 
ee Viclerag 
See 
Ke = eailisrea te 
where, 
d = number of deficiencies, 


Oo 


DDE Vi = ith program's deficiency derived crfectiverpes 
DRIW; = jth deficiency relative importance weight, and 
PPDAJL = ith program's accomplishment of jth deficirenem 


Additional constraints concerning individual mission defi- 
ciencies which establish lower bounds on the deficiercy’s 
accomplishment level may te included in formulaticn 5.5. 
These lower bounds, hcwever, introduce the possibility cf no 
feasikle lirear programming solutions existing because the 
lower kounds are set too high. Adding a new variable, Yj, 
which represents the deviation from accomplishing the lower 
round alleviates this possibility. With the variable Yj 
included the lower bcund becomes a deficiency accomplishment 
Gea. Including the additional deficiency accomplishment 


CONStLraints the formulation becomes 


Nhaxwinize Sum/i [Sug/j [| (DEIN) (abasic (s7o 


Surject tc 


Sum/i [{ (Akai) (Xi) ] + ER(Bk) < Bk 


Sum/i ( (PPDAJi) (X1) ) © UY ae 
0 S Xo 
0 Sayer sal 
10 S711. eeu 
a= “Wemeea 
k Smrlraaat 
where, 
DA J = jth deficiency's accomplishment level, and 
M7 = deviation from CAj achieved. 


The sclution to formulation 5.6 will provide )prcaua 
selecticnh,  prioritizatuen, and deficiency accomplishment 
information. Prograna selection criteria can Fe defined 


according te the Eunding ever If the ith BDT&E proditamm 
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fimaing level, Xi, 1S Zepomue £OllLows that “the ith RDI&Sc 
PRoceavesncuvdmncr De Sclected under the constraints estab- 
lished in the linear froyranm. RDT&E programs that have low 
BeemoOrtetond!l Lunding levels, ~ ki, serve to identify RDI&= 
Frograms that may need to ke reevaluated according te their 
econcmical accomplishment of mission deficiencies fricr to 
continued investment. 

Temeprmerrmtize the RDTSE programs, two possikilities 
follow frem the present MCDEC process and formulation 5.6. 


The pessible prioritization vectors are 


( (LEEV) (X) ] (5.7) 
CEs 

(X) { (DDLW) (DDEV) +(SELW) (SEV) 1 = (X) (FPV) (5.3) 
where, 


SELW = suljective evaluation list weight, 
SEV = sutjective evaluation value, 


DDLW = déeficiency-derived list weight, 


DDEV = deficiency-derived efficiency value, 
FOV = final program value, and 
X = pregram prorertion funded. 


Eguations 5.7 and 5.€ represent vectors that could Le used 
depending on the impertance given to the vector SEV. The 
listings weights represented Ly SELW and DDLW are assigned 
Fy the Prioritization Working Group (PRWG) to compute the 
fev in phase III of the MCLEC process. Peecus) Landang 1s 
available, ranking prcgrams by eguation 5.8 is equivalent to 
the current MCDEC pricritization process. 

Forpudation 5.6 also provides a proportion of defi- 


ciency accomplished according to the value 
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Sum/i [ (PFDAJ1) (ope (Sc 


This infcrmation would te valuable to a decision maker for 
identifying deficiencies that are not fully acccnelisieg 
The additional variatle, Yj, provides Similar identiticamaen 
informaticn concerning deficiencies ot achieving §taeue 
Minimum acccmplishment levels as set by the constant DAj. 

Tc further illtstrate the linear programming model 
formulations presented in this section a larger set of 
Tevelcrpment Center-prcduced MCDEC process test data is used. 
The cata involve 158 mission deficiencies and 74 kRDI&E 
Frograms. The proxy budget data 1s obtained by using the 
Same year RITSE, Navy fOM. 

Table VIII shows the results of this larger data set 


when sukjected to fcrmulation 5.2. The table lists jeu 
columns. The first two cclumns from the left name and 
describe the budget conditions used. The next three list 


the numker cf RDI&E programs fully, partially, or not}2 ee 
respectively. The last column provides the number of changes 
to the original pt&cecgram pricritization list wheniieae 
formulaticn 5.2. The results depict the RDT&& program eevee 
tion rroduced by the linear programming model soluticn for 
fTaxitizing the Final Program Value (FPV) subject to five 
progressively restrictive budget cases. As should be 
expected, fewer programs are funded fully as budget reduc- 
tions are imposed. However, if the FPV prioritization 
listing is used to sélect the funded programs, the optimal 
selecticn cktained through the linear program may not be 
produced. The right hand column of Table VIII provide wae 
number of frograms whcs priority position 1s lowered@inten 
the ccnstrained case. This column contains the number of 
rrograms which Lost thre iz PrLlOrity |) positiew bkecause 
(FEV i) ae) <<. (PED) ieee where 1 represents the prcgran 
under consideration and b represents the program initially 
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Bowe dmanccmcateyeDelew the ath program. These numbers are 
an indication of tke the differences in selesting RDT&E 
PEcgraliset yma 2itedar programming Solution rather than the 


Peat enor taczed list produced in the MCDEC process. 


i -  —« ————— ee a 
| TABLE VIIlL 
| Results of Fermulation 5.2 with MCDEC Data 
| | 
| Case ER Program Funding Prieonpi ty chan ges in | 
ual Part None FEV Ranking | 
| A O02 00 74 0 0 0 | 
E G2 10 a2 7 1 2 ! 

| C oe |S 71 1 2 Z 
| [ O25 69 Z 5 > 
if O31), 61 2 11 ie | 
g | 
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iors Nuor OL tcrmulation 59.9 with the set c£ MCLTEC 
Bere co @cata is s1OWRin table 2k. These results defict the 
linear fyrogran SOLUELON LOE na Xi ni Zing the program's 
Deficiency-Derived Efficiency Value (DDEV) when subjected to 
Frogressively restricted budget constraints. The nceticakle 
Soluticn difference LEetween maximizing DDEV instead of FPV 
is the larger quantity of RDT&E programs dropped during the 
DDEV Eudcet reducticn conditicns. The differences between 
the twec formulation results is due to the lack of the 
Subjective Evaluaticn Value (SEV) in the DDEY soluticn. 
Assuming that the [IEV is a more direct and okjective 
Measure cf FDTE&E program acccmplishment of mission deficien- 
cies then in an actual app lication Mien war tisaliy funded and 


non-funded programs would te wientam ned fOr Piet cer 


€valuaticn prior to selection. The right hand cclimagige 
Table IX provides the number of programs whose friority 
positicn lowered when comparing a ranking of (Xi) (DDEVi)ee 


a ranking according te the vecton DPEVeonE 


TABLE 1X 
Results of Fermulation 5.5 with MCDEC Data 


oct SEAS SARs SE SR SER Saas SE SOS aces SPDR SE NES Sea 


Case wes Frogram Funding Priority Changes in 
Pee Part None Spey Ranking 
A 0.00 74 0 0 0 
E O40 71 1 2 3 
c Oa 1s 69 1 4 4 
c 0.25 60 1 1 ee 
E Cae 50 2 Ze Ze 
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Fermulation 5.6 further restricted the Maxi mizau tenis 
sum/i [| (DDEVi) (XL) )) ogee ne Puan constraints for each 
missSicn deficiency in addition to the budget constraints. 
Table X provides forgulation 5.6 results when uSing the same 
NMEDEC Modata- In this lllustration the jth Defeat, 
Accomplishment (DAj) value is set equal to a single guantity 
for all deficiencies. This value for DA represents a defi- 
clency accomplishment goal which the model user would like 
the pertficlio of selected RDT&E programs to achieve. As 
previously stated, this goal may not be feasible with 
currently ccnsidered frograms. The variable Yj in forrula- 
tion 5.6 provides assurance that a feasible Solution wile 
obtained, and it provides identification of the ceficiercies 


that fail to meet the user's goal. If Yj 1s egual to zero 
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Bilemetic germoeticiency goal, CTA), has been met. If the Yj 
value is one then no accomplishment of the jth deficiency is 
provided under the specified set of constraints. The results 
cf four cases are shewn in Table X. Four values of DA are 
used and each DA case is further subjected to five kEudcet 
reducticn conditions. For each case shown in Table xX the 
kudget reductions impose the same RDT&E program selection 
PorEtrteclicsd= in ELormulation 5.5. The two priority change 
columns provide the number of programs that lower their 
priority standing as aresult of the linear programming 
model reducing the funding proportion Xi to obktain an 
cptiral] ¢clution. 

The deficiency accomplishment columns, of Table x, show 
the numker of deficiencies that obtain the goal of [CA in 
€ach case and the numters of deficiencies partially and not 
accomplished. In tre fully funded cases all RDT&E frograms 
are sé€élected as in the current MCDEC process and all éefi- 
ciencies are at least partially accomplished. Case I-A shows 
that 74 deficiencies are greater than or equal to 100 
percent acccmplished and 84 deficiencies are less than 100 
percent alleviated. Case IV-D shows that at a 25 percent 
rEudget reduction 87 deficiencies are accomplishei at greater 
than cr egual to 85 fercent while 63 deficiencies are less 
than €5 percent alleviated and eight deficiencies are not 
accomrlished. For this data set, these results imply that 
even wher all programs are fully funded many deficiercies 
are net acccmplished at the set goal while others are using 
resources in excess ci that reguired to meet the goal. ae 
the data usei in this illustration 25 deficiencies were 
accomrlished at 200 percent or greater and the largest 
cveracccmplishment was 535 percent. Numbers representing 
deficiencies move f£rcem the DA column to partial and not 
accomplished columns as budget reductions were imposed that 


Beauce funding Ecr programs that support the specific 
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TABLE 
Results of Fcermulation 5.6 with MCDEC Data 


| 
| — ao | 
| Case Pecaqran Pr lone Detleclener | 
Fu higa ng Changes Accomplishment | 
[TA OER Fullerton. Nome DDEV sr Bye art None | 
Case I \ 
fee Ve Gwar 74 0 0 0 0 74 84 0 
B ee 71 1 a 3 3 74 oe 1 | 
c «15 Cg 1 4 ~ 5 is ey 1 
D oe 60 1 pig 5 14 70 83 E | 
{ £ 0 50 Z 22 18) 24 61 87 10 
| 
| Case dil | 
hee eae 74 0 0 0 0 tol 81 0 
B oe 71 1 2 3 3 la 80 1 
c al 69 1 * ~ 2 76 82 1 
D oo 60 1 13 i 14 Es id g 
a 0: 50 yz ae Ze 24 o4 ey 10 
Case iif 

A eo eeoe 74 0 0 0 0 89 69 0 
B - 10 i 1 2 iB S oe 62 1 | 
Rec - 15 69 1 + * 5 Gis 70 1 | 
D aS 60 1 ee 13 14 3 3 67 e | 
| E 0 20) Z 22 25 24 76 ez 10 | 
| Case IV ] 
| yates ee 0 74 0 0 2 0 23 Cm ¢ | 
B 110 774 1 2 3 3 ge Ce 1 | 
c mS 69 1 4 4 a an C6 1 | 
D > 60 1 iS is 14 87 63 g 

E aoe 0 50 Z eZ Zo 24 30 68 10 





deficiency. In all DA goal cases, one mission deficiency was 
not acccmplished at any percent when a budget reduction or 
-10 or .15 was imposed. When the more extreme budget reduc- 
tions were imposed mcre programs were not funded and more 
deficiencies were not accomplished. The linear programming 
soluticn precedure ccncentrates resources into programs that 
accomplish deficiencies with the highest Deficiency Relative 
Importance Weigkt (DRI¥) and does not prevent over acccn- 
plishgrert in excess cf 100 percent. This allows an Optijmam 
formulaticn to occur with a pertfolio that does not cele 
RDT&E programs that cnly accomplish deficiencies with a low 
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Pare N= chowi in case E=-57) 61 deficiencieS were acccn- 
mieanicec auecmegiecater than {60 .rercent while 10 Jeficiercies 
were not accomplished. Nemecome Ppolnt nonaccomplishment® of 
the less important deficiencies will outweigh the benefit 
from cveraccomplishment of the more important deficiencies. 
Picmrrrammelinear programing fLormulaticn propesed here 
does nct duplicate tke MCDEC process in any obvious way Eut 
Sencentrates Om MaXl@izing the quantity of all deficiencies 
acconirlished. The fcllowing formulation uses the previcusly 
defined variable Yj as the deviation from the set deficiency 
accomplishment goal. The formulation for a goal of 100 


Fercent follows as 


Teen rtZO eS m/ 5 f Yj. (Stoo 
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Metm@ulation 35.10 optimizes deficiency accomplishment by 
Hinifizing the deviation from full deficiency alleviaticn. 
Programs are restricted ty budget constraints and are 
selected according tc the proportion of deficiency acccn- 
Flishrent tkey impart to deficiencies still below the set 
goal. Takle XI Summarizes the results of Formulaticn 5.10 
With the MCLTEC process data set. In yeneral, fewer pregrams 
are required to provide the same mission deficiency acccn- 
plishment than when ail programs are fully funded. Net until 
an extreme Ludget reduction is imposed does the guartity cz 


Meee ee OL Creater accomplished deficiencies decriice. 
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TALLE Xa 
Results cf Fermulation 5. 10Mwrtn Mere ore2 aa 


Pace Procran 2 LOG ay . Gre tes 
Dee eno Funding Changes ACC Qmpdl 1 Shir ems 
BR Full Parte None Jo eee 21.09 Part Nem 

A .CO 6 J 2 8 13 ie 74 84 0 
Bees 0 60 € 8 14 14 74 84 0 
Ge 15 ae 7 9 16 15 74 384 0 
oe ae 55 c is 2) 29 74 84 Q 
Ee a oO au] 10 43 54 5 70 8 8 0 
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By cencentrating on the number of deficiencies acccn- 
rlished, fcrmulation 5.10 identifies programs which may not 
ke reguired even when funding is available. The solutikgm 
values of Yj previde an identification of the dericirejewe 
that re,uire more RITI&E program dedication to achieve £ule 
accomplishment. Table XI case A shows that for the sane 
deficiency accomrlishment results as case I-A O£ Sab 2 ee 
only €1 pregrams recuire full funding and five necdianae 
Fab tial tune wigs Case I-A of Table IX allowed 7/4 fugue 
funded programs. This reducticn in selected programs repre- 
sents an 18.7 percent total funding reduction over the five 
kudgeted years anda9g9.9 percent fundins reducticn in the 
most restrictive year. The FDT&E programs not funded in 
Jable Xi represent those which should be reevaluaté€d asim 
their extent of deficiency accomplishment prior tc sélec= 
tion. If these prcgrams are not selected this may lead to 
the reccvery of resotrces tc frovide greater accomolishment 
c£ the partially alleviated deficiencies. 

Unless the values of DDEV and FPV are used, fornuiation 
&.10 does not frovide a means to completly pr lolritivzeuee 
listing ci FOTGS peegrans- Formulation 5.10 does separate 


the frograms into the three funding cCclassificationecwees 
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ee Comedy and noteacumded. ce cee © amma siteiGn. 1S 
Decqipeeca, eerie l,) Lurced peegrans, would logically form the 
Poe Stmeprncreity and the not ~rurndeds :royransmyOuld fortmethe 
Mewes t DLiomaty = claSsilication set. The paetgally runcei 
rrograms would form the middle priority set of programs anc 
ould te further. rcarked within this set according to their 


Bmespective fUmdine. preporticn Ki- 


wee) DSCUSS ION 


Two géreral apyroachs tc gone (Cs “Guo Ori CiZzat ton 
Meocess Using linear f~rogramiiig have bee. proposed.  Ff..2 
mies apphoaca demonstrated Gi f£ormulatigus 5.1, 3.2, 3.4, 


Beso, and 5,6 maximized the MCDEC process values concerning 
RDIGE program relaticnships to mission dériciency acccn- 
Prersh ment. Each Of these Zfcrmulatiors have an unconstrained 
Case where they duplicate the currentiy proposed CLEC 
process. MOrmillatLen 9.10 DeGVLesents” a secord methcd to 
MmmEodcn the mCHEC™ pfrocess through concentraticn cn the 
guantity of deficiencies accomplished and selecting fregrams 
as needed to obtain ar accomplishment goal. These apEeroaches 
Meer cemUlations alivetrate the feasibility and flexirilit” 
Beep che linear programming pertrolio selection aolel as 
applied to the MCDEC ;rocess. The results listed in tapnles % 
Mees. SrOw that for small Eudget reductions both a,;roacnes 
Meweet eLograms that ~rovide Similar guantities Of delicien- 
eres acecni~plished rut formulation 5.10 provides i tess 
Ccustly alternative tc achieve these deficiencies. 

Bemdcee jemene Eostlcseor any Jinedar srogrammin¢g ~ ¢lioach 
aa gjei aSsumpcion must be accepted. Linear proyrisming 
assumes that the relationships of coefficients and variables 
used in the formulaticn are linear or, at least, that linear 
functions satisfactcrily approximate the actual relaticn- 


ships. Intuitively, and as presented in some of the 


a 


literature, these interrelationships between RDT&E programs, 
resource exrenditures, and tLenefits navy not be linear Eut 
instead may be seme cther functional form. The iinear func- 
tione, however, do frovide an approxination to the) acuuae 
Situaticn which is urderstandatle. The proposed formulaticns 
are ressibilities which can serve as program selecticn tToee 
and net as decision sakers in and of themseives. 

Ic further investigate the linearity assumptiors, the 
relationshirs of the several individual coefficients and the 
two fFrepertional variables shculd be discussed. The vague 
ables Xi and Yj which represent proportional values can both 
ke readily accerted if their respective coefficierts are 
properticnally divisitle. In the proposed formulaticns eee 
kudget ccnstraints used the quantity {§ (Aki) (Xi) |] te demu 
the Eudget allccaticn to the ith program in the Ktheaame 
BeELcd. The linear assumption maintains that a fpregram 
funded at a fropcrticnal amcunt less than one will yieid the 
Same prepertionai teéenefit. In actual applicaticrs (ime. 
linearity assumption may not te appropriate throvughcutmer 
entire range of Xi from zero to one. Some programs fay 
require a proportional funding lower limit greater than zero 
to remain a viable KLT&E progran. For this condition maa. 
ith program which requires a Minimum funding level could 
have the respective funding froportion variable Xi defined 
at zero and over a range frem the minimum funding frepertion 
to one. Another ccndition may. reguire either full cr no 
funding. This condition could be achieved by defining the 
variakle Xi at the intejer values of zero and one cnily and 
utilizing integer programming computations to) 2inceeee 
optinzal yrogram selection. 

A sinilar discussion as presented for the budget (CoOcmiam 
cient, Aki, can lead to acceptance of the linear assumpticns 
concerning the ccefficients FFVi, DDEVi, and PeDAji asienee 


are proportionally reduced by the variable Xi. First, these 


SGeteicicitemUsts be acceated themseives as values caralle 
SLeectoininguenelr Lener2 2 “measurement properties during 
inepeat Programming CCH;Utataons. Stevens [ Ref. 26] frorosed 
the four measurement scales of nominal, ordinal, interval, 
alae reatic which are helpful to discuss the properties of 
these coefficients. 

Briefly, nominal scale measurements represent numerical 
Haentiftication £cr an item or event such as an auto license 
ctlate numkter and does not have any mathematical preperties 
associated with it. Ordinal scale values measure rank 


erderirg only such as the priority numbers of 1 tnrrcough 74 
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fPevemmstc the RETEE programe as a result of the MNCLEC 
process. Interval and ratio scales Maintain a comparative 
worth ketween values. The interval scale has an estabiished 
interval unit and each specific value is neasured by the 
number of these units that separate it ‘from other reasure- 
ment values above or Telow it cn the scale. A natural orisin 
is net always established in an interval scale even if a 
zero value exists. The zero values on interval scales are 
assigned to arbitrary points such as on the Celsius of 
Fahrenheit temperature scales. Ratio scales have a naturai 
Seigis ion addition tc the properties of the interval scales. 
Ratio scales are capakle of fproportionai comparisons cf the 
Numerical values such as stating a program which ccsts two 
Millicn dcllars is twice as expensive as a one nillion 
dollar program. To maintain the same measurement propertié€és, 
ratio scales can withstand multiplicative transformaticns 
Oniy. IpneaneckansiLcCrmatvons can result in other ratio 
scales, however, the new values will be measures cf a 
mircterent attribute than the first. 

In linear equaticns, values with at least interval scale 
properties are necessary. In linear programming, however, 
the ccefficients require the additional properties of ratio 


scale méasurements to withstand the ratio comparisons of 


coefficients and right hand side vadiges. In Chapter ig 
FPDAJi is defined asa straightforward estinate GL tice 
program's proportion of the jth deficiency acconplishteme 
If these estimates are accurate, the coefficient PPDAji can 
ke acceptatle as a measurement on a ratio scale. The CDEVi 
coefficient 1s a Summation of individual proportional tea 
formaticns cf each fFFPAji based on the Deficiency Felative 
Importance ¥eight for the jth deficiency (DkIinj). Ihe Dove 
can ke accepted as a different ratio scale feastrement by 
accerting as valid the multi-attribute utility danhatyee 
which is used to derive the DRI¥Wj. The FFVi is a linear 
functicn of DDEVi and a Delphi process-based Suk jecua 
Evaiuaticn Value (SEVi). DDEVi and SEVi are both adjusteGue 
the ccnfidence factors of the Deficiency Derived List Weight 
(DDL) and the ith program's Subjective Evaluaticn ieee 
Feight (SELWi), restectively. Although not Speciftieame 
stated by Creec, [Ref. 25], all DDEVi in the sasple Mega 
Gata set were adjusted by a common DDLW while each SEVi was 
adjusted by ats srecitic Siu Accepting FPVi as a 
different ratio méasurement of RDT&E program benefit 
reguires accepting (SEVi) (SELWi) added to (DDEVi) (DIL). 
Althcugh beth FPVi and DODEVi might be accepted as irauus 
scale measurements of RDT&E pregram benefit, because Gia 
functional change between them, they do not measure the same 
@EEEirutes cf thelith erograne The vector (SEV) (SELW) vadiea 
does not represent the same yualities as the vector SEV 
kecause cf the evidert change of SELWi according te Weqem 
EZOg fal. 

The MCDEC prioritization process proposed only themes 
to represent the firal relative worth of RDT&E programs in 
the acccuplishment of mission deficiencies. If tais value is 
acceptable then formulations 5.2 and 5.4 provide examples of 
linear programming fertfolio selection models which will 


faintain an optimal frogram selection portfolio under budcet 
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B=souEGewbccuct2ons. If the ~subjective evaluation addition 
included in the FPVi definition 1S not acceptable then the 
multi-attribute analysis of individual deficiency importance 
Gaieeece itetdacd by faxamazging Sum/i [| (DDEVi) (Xi) ] as in 
Zormusatlons s75 and 5.6. These formulations allow prcecgran 
selecticn scluticns under budget reductions which may nct Le 
Poecabned through pricrity listings only. The last formula- 
mEoOn ap-p_Lcach, Wiwem docs note darectly cepresent the 
GUrrentiy proposed MCLEC precess, appears to be a favoratile 
RDT&E pregram selecticn model as shown from the example cata 
set. Formulation 5.10 provides identification of frograns 
requiring reevaluaticn, deficiencies reguiring dedicated 
Peograns, anda selection of frograms that accomplish the 
Maximum deficiency alleviation. It should be noted that in 
all the preposed linéar pregram formulations the soluticns 
are cytimai computaticns of the benerit and coefficient data 
provided and can only be given the coniidence inherent 12r 


the data themselves. 


ue 


Vie CONCIUSIONE 


Ae re cults 


This thesis has investigated the MCDEC Pricritization 
Process. .ThiS process was froduced by the Develcpment 
Center, MCDEC, to establish the relative importance Creno aa 
programs prior tc Marine Corps input to the RDT&5,N FOR 
investigaticn of tke literature showed that the MCLEC 
Frocess can be classified with similar benefit measurement 
models currently accerted by industry. The literature also 
identified cther proresed and accepted RDT&E progranr selec- 
tion models, classified as portfolio selection todels) Vina 
showed pessible advantages that could enhance the proposed 
MCDEC frocess. Several MCDEC process linear programing 
model modifications were presented and showed the pertfolio 
selecticn model advantages of maximizing the benefit func- 
tion when subjected tc resource constraints. 

The feasibility cf representing the MCDEC process asa 
linear programming fertfolio selection model was illus- 
trated. These illustrations raised the possibility tnat the 
Final Prcgram Value assigned in the process night not be the 
Fest measurement of RIT&E frogram misSion deficiency acccnH-— 
Els hMent. Another linear programminjy model apprceack to 
selecting the RDT&E frograms, represented Ey the example 
data, was also illustrated and provided an economical alter- 
native fcr maximizing deficiency accomplishment. 

Currently a mathematical analysis support model is used 
as a tocl in the Procurement Marine Corps POM process Eut 
not in the development of the Marine Corps porticn orm. 
RDOTSE Navy © eeu: According to the (literamie? industry 


accepts the use of sukjective input with analytic tcols for 
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Robo EMPregdrameselecticn applications. Tre CO bemerCCcCess as 
Deestand= som with the portfolio selection enhancenerts kas a 
basic tou assist @S an analytic tooi for the Marine Corps 


respensikilities in the RDT&E,N PCN process. 


Ea fTUFITEER INVESTIGATIONS 


Several areas of further study and research are evident 
from this investigation. The variety of program selection 
models proposed in the literature each have advantages ard 
Gisadvantages which require further investigation as to 
mei t pcssable application to the Marine Corps exDISE pregran 
selecticn process. tie dd -amyaeneri mg “and? -coipiling tech- 
Tfigues of these additional models reyguire study as well asa 
complete analysis of the data and process results [froma 
G@ompiete trial HCDEC frocess run. The most difficult furtter 
research will be to estimate the model costs and pertecrma 
cost Eenefit analysis of implementing a RDT&= program selec- 
tion model frocess. 

The literature review charter presented model evaluation 
criteria ard limitations suggested Porcemlowscetal Bf) 
Frogram selecticn mcdels- Simeon beseakecneis  Lequi rec 
into the applications of these or similar criteria and lini- 
tations in the context of Marine Corps applications sfpecifi- 
Cally. The extent cf industrial model applications tc the 
Marine Corgs will te limited because of the non-profit 
orientation of defense. However, the other portfolic selec- 
tion models reviewed in the jliterature may provide valuatle 
alternatives to the presented MCDEC linear programming 
model. 

Subjective evaluation of RDT&E programs was seen 
accepted asa necessity in the literature and was seen 
Froposed for use in the MCDEC process. The manipulaticn of 


the subjective data by the MCDEC process was discussed here 


a 


in ccentext cf measurement scale properties. Further investi= 
gation irto the subjective values and their true measure- 
ments is needed. Saaty [Ref. 24] and Lindsay [Ref. 27] have 
rropcesed different methods of Combining subjective | jug. 
ments into quantities that maintain measurement scale frep- 
erties. Further investigaticn into these or other surjective 
judgement methods may provide more acceptable alternatives 
than the Delphi and value manipulation methods currently 
Froposed. 

Fermulation 5.4 illustrated the possible resource allo=- 
Cation advantages from assigning a proportional pregram 
funding variable tc each year in the planning horizon. Mhe 
kenefit received from the programs, however, may alsc change 
cver time. Further study is necessary to investigate the 
Frogram tenefit measurement values used in the opcrtfolio 
selection models and how these values change over time. 
Additional variables and benefit coefficients necessary to 
descrire each time period will increase the computer stcrage 
and ccmputational recuirements and this increase will also 
need investigaticn. 

The costs and tenefits cr implementing the Propels 
Frocess alsc requires further study. The current precess 
software was developed fora Tectronix 4054 minicomruter 
and is net compatible on other systems. Resources in terms 
ef manhours and money will re required to upgrade or repro- 
gram process software to ensure compatibility with mirceccca- 
Futer systems currently at HQOMC and the Development Center. 
The presented linear programming computations utilized a 
Ketrcn, Inc. MFSIII Dataform package aS run On an TEM 
computer. Further investigation into microcomputer linear 
Frogramirc software is necessary and represents additional 
GOSts. If large linear programing packages are required to 
enhance the process additional mainframe usage will add 


costs. Gathering the subjective data from operaticnal and 
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Hon OmeedtTenaeeuni tS during the WMCDEC process survey anal- 
ysis represents mMmanfewer and SAO COSts ROL. Currently 
reguired. The total monetary benefits are possikly the 
hardest to classify cr estimate. The value of valid infcrma- 
tion concerning new defense systems and programs as they 
affect tte missicn accomplishment of the Marine Corps will 


need further research to yuantify. 


ES 


MCDEC PRIORITEZAT IONS OGe oe 


This appendix displays the organizaticnal Structuceuees 
the Levelcfrment Center, Deputy Chiert 4%68 Stari ““eorm 
Develcpmental Coordination, Prioritization Working Gigi 
and Chief ct Staff's Prioritization Committee in Figures 
A.1, A.2, A.3, and A.4 respectively. The remainder cf the 
appendix details the fhases and tasks of the MCDEC prioriti- 
zaticn frocess and lists the specific Development Center 
agency resfensible fcr completing eacn step. The purroses 


for each fcllowing tasks are quoted from Creed [| Refly2aq8 
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A. Ehase I: 
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Chiet Command, 


Prioritization Committee Structure. 


Determine deficiencies and requirements, 


Task 1. Preparation of plans 


Dates; 1 January to 28 February 


Agency: Planning and Evaluation Branch 


Purpose: To provide an approved basis, via _ guidance 


and direction set forth in 


Marine Corps plans, for 


subseguent Mission Area Analyses, by updating 
and/ycr revisicn of Easic. Marine Corps planning 
dccurments - 1.€., MMRCP and MLEP. 

Task 2. Survey Aralyses 
Dates.) \ January to 30 March 
Agency: Analysis Supfort Branch 
Purpese: ie Gather Opinion input from FMF and 
other appropriate ccmmands/fagencies regarding the 
effectiveress cf ongoing projects in the R&C 


Frogram and tc solicit new program ideas. 


Task 3. Mission Area Analyses 
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B. 


Cc. 


Dates: 1° Naverre 50 Apmis 
Acency: Planning and Evetuaticwe ete 
Purpose: To frovide the basis £Cr jUStitveqetogees 


R&L projects via specified Marine Corps dericwem. 
ci€s “reSulting from Mission Area Analysis. 


Fhase ITI: Pricritize deficiencies and requirements, 


Task 1. Mission Area Analysis Results Brierings 


Dakes: 1 May ve wisemtay 


Agency: Plannirg and Evaluation Branch 


Purpese: Tc provide the Prioritization Werke 
GLOUEL (PRWG) with Mission Area Element (s 
deficiencies-criented briefings in reparaticn for 


the FRHG MAA frioritizations (Phase II Task 2). 


Task 2. Survey Aralysis Results Briefings 


Dates: 1 May te 15 May 


Agency: Analyeis Suppor’ frances 


Purpcse: Tc provide the Prioritization  Worxkame 
Group _({PRWG) with FMF/major command and agércy 
derived input cbtained during Phase 1, concernua 
deficiencies. 


Task 3. Design of the Deficiency decision tree 


Dates: 15 May te 15 July 


Acency: PrlLoritazarmer Working Grour (PRWS ) 


Purpose: To ee cee derive, vis nul tis 
attribute a ae analysis, a consolidated cank- 
crdering af all Mission Area (element) deficiencies 


sue an associated relative importance weight of 
each. 


Ehase III: Prioritize F&D programs, 


Task 1. Program Froject L-riefings 
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Dates momo uly toms August 


AGenleye Pevyrslon 0Pe Ss ) (scncduled by J peraticrs 
Brancn) 


Purpose: To frovide Bea ea cory informaticn to _the 
LEaemeerZzatton norma g sckoOup and Chict of Stafi's 
GenMiteees:rcr CONSideration ih subsequent pricriti- 
zaticn deliberations. 


Task 2. Survey Analysis Results Briefing 


Dates: 15 July to 15 August 
Agemey: Analy=2z= Support Branch 


Furpose: iC PEO ware Oberg hs een informzatior 
derived from FMF/majcr ccmmands or agencies to the 
Prtenmmegat On WOrKIngeeGroun and Chacr of Staff's 
Cemmittee for consideration in subsequent prioriti- 
zation deliberations. 


als ees Sige CrlVOmm—~rE@OLItizatilon ef RSD frcgran 


Fro-ects 


Dates; 15 Augtst to 1 October 
AGeQe@weme Analysis Support Branch 


Pieeese-. LO Cbtain a subjective pri 
R&D Bence ee with associated weigh 
each reflecting relative worth. 


Task 4. Deficiency- Derived PrvOr2 tz Ol Ce 85,5 


Ereésects 


Piateesie io AUgGtSt to 71 October 


Agency: Prioritizaticn Working Group (PRWG) 


lecese. sy lO Oktarn a C~riQgritization of RED eee 

PEeweces) Gahkcad sand weighted according to hat 

Eee ieaans Catadibwuaty to overcome MiSsion Area 
letent deficiencies. 


Dic meee tnd OoTIGritazation Of RGD projects 


Dares me eeectoler to. 715 October 


Agency: Prioritizaticn Working Group (PRWG) 
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Purpcse;: To cbhtain a final S5FiOritizaewomcee ee | 
program projects frcm the Sub jective-derived a7. | 
and ceficieney-derived list Companed. 


Task 6. Director Develogpment Center, Decision Brief for 


AGtelon 


Dates: 15 Octcker to 31 OGtober 
Acency: As Directed 


Purpose: To present the recomMended R&D) progman 
EIO}ject PLLOLTity fonredeciston- 


ES Ehase IV: Complete MCLTEC R & D programs list in HMC 
EON: 


Task 1. Application of funding profiles 


Dates: 1 Novegker to 31 December 

Agency: Oferations Branch 

Purpese: To determine recommended yt undin7 ep prec 
= 


te reflect the desired DELOFIU1 Za Eee reeon 
Program Projects. 


es 
on 
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